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ABSTPACT ^ • ^. ■ ^ 

A national stirvey vas designed^ to obtain information 
in four principal areas of concern: (1) ifhat preparation medical 
faculty members had fot their roles as teachers; (2) instructional 
Vractices of medical ficulty; (3) where faculty are experiencing ' 
difficulties in teachiilg; and (4) ifi vhat areas they are interested 
in receiving help. A stratified random sampling of 2,700 faculty 
(representing over 28,000 full-tine medical'*school faculty members) 
was used for the suryey. Findings shov that: (1) faculty have had 
little formal preparation'f or their teaching roles, with only'21 
percent having taken education courses 'and 39 p&rcent hairing attended 
an educational workshop; (2) faculty make consider ably^more use of 
traditional than innovative teaching techniques such as lecturing;* 
(3) faculty are not thorough' in their management of(th€f instructional 
process; §ind ^^) they, express interest in improving their teaching by 
reading and attending educational workshops, especially in the. area 
cf insjtruc tional evaluation. (Author/HSE) . * 9 
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EXECUTIVE. SUMMARY' . 



I 



PUJ«»pSE. 

This national survey iwas designed to obtain infer- ' 
mation.in four principle- areas . of concern: 

1. What preparation, medical faculty members have ' 
had 'for their rol^s as teachers, , ' ' 

••^ , 

2. * Wljat instructional practices faculti^ merijbers use 
in their teaching, ' • • * 

3. Where fac^lty ace experiencing difficulties in 
^their teachij>g, and ' * . » 

' 4. . In what* -instructional' arenas- facufcy .are inter-, 
-ested in repeiving help. ^ ^ 

The- intention was to c^riv^e findings th'at^could^be 
useful: to the< sponsoring agencie^ in allocating future 
resoAirces in sup£)ort of faculty development, t6 the Divi- 
sion of Faculty- Development In guiding plans for programs 
far Association of American Medical Colleges constituent! 
aB a "base-*lin^'" against which future comparisons cafi be', 
made, and to individual medical schools in ^uidihg the 
design of faculty development activities. ^ 



METHODOLOGY - " . 

ihe total^ population represented in thit. study- is 
the 28,393^ fullytime medical scl;iool faculty with teach- 
ing responsibilities for undergraduate 'students. A 
matrix, sampling "design was used to sample on a strati- 
fied random 'baais 2,700 faculty from the population and 
to randomly assign three f roA >a group of eight s-urvey 
packages to sub-groups of the ^sampje. A ninth package 
went -to the full sample. ^ - • 

The . surveys were distributed andjf ollow^d 'up by 
representatives at eagh school. Usab/e responses were ' 
received from 71% of the sample. 

^Specif 1 comf)uter ^programs were written to analyze 
the data an^ to present es-timated population values* 
based on the statif ication techniques. The basic re-" 
suits, without;, interpretation,^ were distributed in three 

r ■ 



11 \ • - » 



prelxminar.y. ^reports" (iijcluding ^dat^ for the total - 
populati(>n, and'^for grop^ing& according to school siz;e, 
school- ownership ,^ depar1;jnental* affiliation and academic; 
rank) . Thda^|^ r^o'rt*^ d^»mlmds< totally^ restricted. t6" 
.analyses and iifi^e^^^eSr^tians Jor-the» total 'population. 

MAJOR FINDIJiPS' , ^ . : ^' 

The "major findings p^^es^hted and discuss^ed in this 
-rej^ort are: . / , , . ' - " • / • 

. ^ 1. Faculty have had little formal pf epai'atioft- f or 
their roles as teacher^s: It' is estimated tTTaF only 21%^ 
have taken :::;a3»es- in education and that only 39% have^ 
ever attended -an educational workshop'., 

2. Faculty mak^caasi.derably more use of. .trada- " 
tional /than "innovatiye'^ristructional » methods . "For 
example, 56% u^e lecturing 6n a frequent basis, while 
only 1% use computer assisted- instruction frequently. 

3. Faculty are not thorough irf their management 
of. the- Instructional process. They gather ^little Tiack- 
ground on their students are not explicit concerning 
their expectations -for students, and are . less th^n .sys- 
tematic in their evaluation practices, v - ' ^ 

• . ' . 

4. Faculty express-a considerabl-e interest in 
ijnprovisog their .teaching through reviewing; printed, 
material ^rid attending educational workshops. For 
example, -84 : wCuld like 'printed material pn eVal-uating 
their effectiveness as tochers and 39% would' attend a 
workshop on. this topic. ' 



CONCLUSION , . * ' ■ . 

The high response rate (71%) provides a basis for 
considerable confidence; in- the findings pi^esented. There 
is also a basis for encouraf^ement for the future qualify 
of American* medical education in the*high interest fac- . • 
ulty members indicate in receiving help in /improving 
their instru9l:ion. The'^study, succeeds as well in^icleh-r 
titying several areas of high need .fpr instructional 
improvement, some of wliich are also areas of l^igh.fac- 
ulty interest. Th^.nfext taSjjfS will be the promotion .and. 
i/nplementcrtfion of faculty deVelopment^ activities in those 
areas where there are /both high need and high Interest. 



INTRODUCTION 



BACKGROUND' ' > . , ' * ' - 

Irt August, 1974 the Association of American Medical 
Colleges (AAMC) Created the Division of Faculty Develop-t 
ment (DFD) . The charge to the Division's >staff was to 
design and undertaKe programs to assist 'with the improve- 
ment of instruction al^ U/S. tfedical schopls.- \A^|^^rs 
of*th^ staf^^ wev decided' thdN: an apprdpriajfeBr^M^HHBp 
should be a survjey of me'dical' faculty meiribersPWP^^bre 
information on current teaching atid to identify areas of 
rteed, for' faculty development programs . This is the Final 
Report of tHat' Survey^ ' ' ^ , 

- The detailed compilation' of ' f landings ftoin^th^ Sur- 
vey, without interpretative *anaiysi-s %:as preseqJted- in 
three Preliminary . Reports (March', June and July, 1977) , 
whichJ/ere distributee!" to the spon^ojring agencies and to 
each Thiited States and Canadiah^Medical School. The 
present report grovjid^s a morQ detailed analysis and in-* 
telrpretation^^f selected f indings.^ ^ - ' ' 

This 'Final ♦Report is a f ::ee-^,t§lnding document: the 
reader, does no#^need access to thfe Prelim^inary Re'ports 
to understand the , narrative.'. Th6 Fir^!l Report, however, 
is 'less 'complete 'than the Prelijninary^j^leports in some 
respecfts : 4.t foduses/ Exclusively ox\ thfe/ j^indirif s ^ for the 
total faculty . pppulation, omi'lt^nTtg analyses by subgjro^s 
such as professorial* ranK# de^partment, type* of schi^l, 
and size &t school. The hasic fi^ncrfngs of Jhe^e sub- 
analy&es were presented in the Preliminary Reports and 
further analyses were considered tj^yond the ^cope "of the 
present report.- SelectecJ^ f ii^dings '6'f additional analyses 
of. those and other subrgroups will be reported in other • 
publicatior^. * " "-^ . 

Support tot, .this project came f roni a contract wittj^^ 
the Bureau of Health Manpower _(BHM) , grants from the 
Kellogg Fbunda.tibn and The Commonwealth Fund, and the 
-AAMC. ' • , 

; ^ . . . • ^ . * 

FOC^S OF SURVEY . ' * ^ 

* Little solid information is available on the teach- 
ers, .or>^^ teacliing', in sbhools of medicine. There have 
been a few direct observational studies of medical 



teaching,"'' 'but :tbey dealt with relatively small sampleSr 
and njay now b^ put of date. The information on faculty 
membea^s that is gathered for the AAMC Faculty Roster^ is 
demograp^iic or restricted to t^eit p^rof essional dieci- 
plines, .it does not include the -faculty members' 
preparation, fot or views about* teaching,* ox ^activities 
as teachers . 

•The. survey reported here was designed to obtain in- 
forma*tion in 'fqur. principle areas of conaern: ^ ^ 

1. Wfe sought, through this survey, to learn what". 
preparation medical faculty members h^ve.had for their 
roles as^ teachers. This information came from self- 
reports of:- their formal- training in teaching, their^ 
participation in workshops /. and how these and other ex-, 
periences had influenced them. . ' - • 

• . - ► 

2. The Survey sought to identify the specific in- 
structional practices thaPt 'are used by faculty members 

in particular ^i/tuations. We wished to know, for example 
what specific strategies they use and^ the order in whifch 
they sequence thosp strategies when managing an instruc- 
tional tfaBk. 

3. • The /survey undertook to identify problem areas 
in instructi^on. This wafe accomplished both by respon- 
dents identifying problem areas in thdir own teaching 
and by ovir/interpreting ' the survey results. ^ 

"finally, the survey sought to 'identify those 
foblem areas where faculty members woi^ld welcome outside 
^ass istance . " ' ' ♦ ^ 

y^^ ;,^^^he findings from this survey can be useful to Our 
sponsoring agencies in allocating future^ faculty 



Milliard .Jason , "A Study-pf Medical Teaching Prac- 
tices," J. of Med. Educ. , 37: 1258-1284, Dec, 1962 and 
"A Study of the Teaching of Me<iicine and Surgery in a 
Canadian Medical School," Qan. Med. Assoc^ J. , 90: 813- 
819, April 4, 1964. 

• ''AAMC, "General Description of t^he Faculty Roster 
System," Spring, 1977. - (Brochure available from the 
AAMC, 1 Dupdnt Circle, N .W. Washington , D.C. -20036). 



developme;it resources^ to DFD in planning appropriate- 
programs for AAMC constituents / as "base-line" data 
against which compa3;:isons can be made in future Studies 
of pedical iAstruction, and. in guiding the selection of 
areas of focus for faculty development programs at indi- 
vidual medical schools, ' , ' . • 

DEVELOPING THE SURVEY INSTRUME^^T 

With the four -preceding areas in mind possible 
formats for the survey "^instrument were identified- and 
reviewed. rejecj^ed techniques involving "direct 'obser- 

vation of teaching^nd the use' of open-ended questions: 
the?e tecnniques w^re too costly and time consuming ^ to 
be used with a sample of respondents large enough and 
broadly based enough to provide both precise information 
and the degree of generalizability ^e required. ^ ^ 

We §^ttled on two formats. The first is the classi- 
cal f or.ced-choic e item ^ (quest ion) , which was us^d in 
1 inventories (e.g., respondents -ndicated in which of a • 
/list of settings they frequently taught) , to report demo- 
graphic information, and to indicate attitudes <e.g., 
respondents indicated their degree of ayreemenf or dis- 
agreement) . The second format is the wrlt<ten sijnulation > 
This format alloyed us- to. create s*ituatioiys that : .are 
sufficiently interesting to faculty '^to enhance the like- 
lihood of their taking the time tb respood, are 
representative of t)ie kinds* of problems medical faculty 
members actually face, and are consistent in presenting 
each respondent with the same instructional problem. 

In a written simulation the respondent ,is presented 
with a problem and asked which of a series of first steps 
s/he would choose in solving the problem. Depending on 
which is chosen, the respondent is either given addi- 
tional infonnation orpins tpucted to turn to another 
sectioji in the simulatiort booklet, Ttiat next section 
provides new information (which is particular to the step 
selected) and again asks hfUf/her to make a branching 
choice from a set of options. • 



^We did, however ^ use^ open-ended questions to col- 
lect comments f rom responden.ts on the survey instruments 
and^ on the process involved. 
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The branching nature of*i[he written simulations 
allows respondentes to choose different routes, through 
eacrf^simulatiom. Routes vairy according to /their .length 
(i.e., the nymber of sections), the range/of information 
requested , and th^e^ordet in which sections are selected. 

The choice of item format, was rel/ated to th^e . areas 
of research focus addressed by the sufrvey. Respondents* 
preparation for teat:hing , for examp][e , was reported using 
forced-choipe , questions -while infoirmation on instruc - 
ttional 'problems was collected through the use of written 
simulations • I^dentif ication of instructional practices 
■^was made through bojih ft>fced-c^)6ice qff^stions and simu- 
lations.^ ^ , 

Areas in which 'faculty ,/iTie'mbers wou 1(3 be willing 'to 
accept outside ass^^tance were identified th<tough forced- 
chbice questions an^l, questions appearing at the end of . 
esLch simulation on -the tail-sheet — a page of questions 
asking respondents to report how they felt about the 
simulation thev had ^iu£t completed and the instructional 
issues it rais^fl* ' ' - ^ 

e developrfi^rit of the survey Instrument follb^d 
st^^dard procedures. For the forced-choice questions, 

sues of currency^ and relevance were identified through , 
a review of >^iter'3*ture (the last three volumes of the , 
Journal, of Medical Education and the proceedings of the 
Research in Medical Education Conference for the past 3 
years), 'Items' were formulated and reviewed .by DFD* staff 
and then field tested, first among A^^C Staff and then at 
medical schools .ayound the 'country-^ The field trial 
resudts were u^ed as a basis for item revision and 
selection for inclusion in- the fdn2Pi ^form of ti:o survey 
instrument. . ' ' • ' 

OS 

The simulgitiohs were produced in 'a- simiTar manner. 
A large ^body of literature on instruction-related acti^-'' 
vities was- reviewed and a comprehensive outline of the 
instructidtial process was produced. This outline wais?" 
then reviewed and topics fori the simulations identifi?^.' 
A workshop was conv>ened with consultants s.elected to help 



'^The design of th^. wriLtei^^ stimulations is explain^ 
more fully later in this* ch%>< 



wr^te the simulations. The workshop and additional 
ef£?Xrts by our staff after the workshop produced draft 
simy/iations which were field tested. , , ' 

One outcome of the simulation writing' was the deter- 
mination tffat evaluation, the substantive^ area covered 
in the 2nd Preliminary Report , was better suited to 
forced-choice questions than to the s-imulation format. - 
Que^stions on evaluation were therefore written in the 
forced-choice format, using the procedures described 
above. ^ o 

, rifeld trials for the ^ forced-choice questions/ simu- ' 
-Lations, instructions to respondents, and the tail sl^eet 
questions for the simulations were conducted at 7 medical 
3C!h64)ls, covering a' range of sizes (sm^^ll, middle-sized, 
and large) and types of ownership (public and private) . ^ 
A senior administrator ^t each school was asked to iclen- 
.tify individual faculty uiembeirs who would be willing, to 
respcpnd ,to the questions/ And ^sipul^^jt;;^ozi^ as well as to 
participate in a debrief in% .session . '^'T^otocols for the 
debriefing contained questions which allowed us to 
identify^ ambiguities in the i4ems and simulations, dif- 
ficnilties in the instructions) and other problems which 
might hinder the survey. ' - 

^In the field trials- each forced-choice question anS 
ea9h simi^lation Was administered to 10 persons,^ cgtyr^r-irlg 
a variety of academic ranks and departments. After they 
completed the -instrument/ e^h respondent was interviewed 
by a DFD staff member to identify * alnbigui ties and "other 
problems in the draft versions of the materials. 

The field trials we,re completed in late Spring, 1976. 
The results were tabulated' and used to identify weak- 
nesses in the items and simulations, arid t;o suggest 
appropriate revisions. These • revisions were made and 
simulations and itAs were selected for the fin'al veri^ioh 
instpur 



of^the survey instrument. 
SAMPUNG DESIGN 



The^instrument covered a variety of topics, and, as 
anticipatedv wa^ very long; It was composed of- nine 
parts: one CQromon yacka^ge , mc^de up of forced-choice 
questions enc6inpassing demographic information; informa- 
tion on preparation for the teaching role, and 
information on certain aspects of teaching (e.g., the 



setting in which the respondent teaches); plus eight ' sub- 
stantive packages dealing either with problem situations 
in simulation format' or forced-choice questions On eval^?^_p 
uation. ^ Each respondent was asked to take the common ' ^ 
pacKage and only three of the eight other packages ^ with 
the particular combination of ^tfiree baing determined ran-^' 
domly. 'A ' ' ' 

Thijs, each respondent- was given only a sample of * 
thfe packages, and the respondents were themselves sampled 
from the' population lof teaching ^axrulty members, Tbis 
desigli, the multiple matrix sampling approach^ provided 
an jZ^ptimal^ balance of breadth and depth. ^The sampling 
df faculty members was begun' k^y .eliminating from consid- 
eration tho^ persons on medical ^chool faculties who— lyad ^ 
no undergraduate teaching responsibilities (e.g. , full- ^ 
time administrators and liijr^riansy . Next , the remaining 
2S, 393 individuals were class if iedXinto homogeneous ' 
groups Jcalled strata ) accotdihg to\ those variables de- 
scribed in the literature as < important : ^ * size of sclTool , 
ownership of school^., basic versus clinical science de- 
partment, and. academic rank. Fori?y-eVght, strata were^ ^ 
thus produced, ranging' in size from * 8^ persons (basic 
science ins'tructors at'Sm'^11, public schdols) through 
16(72 persons \assistajit professors in c^inicc^ areas a€ 
mediam^sized" private schools,) , 



Fifty-six perspns were randomly selected from each 
stratum to ,be r,esppndents in 1;he ^survd^^:, ^>.^V7e decide^d to 
sample 56 people by considering' the number Nof paqkages 

'td^which each respondent /couldyresp^d without feeling^ 
that we "were imposing unduly. on his/her tameV We decided 
that four packaged (J^^^ common package plus^ three of the 
eight dealing with specific j.ns^U^tional issues) would 
take less than on^^ hou-r to complete and an houE was the 
maximum jwe cculd expect from the busy people , who consti- 
tute our pdp.ulation. ^Fur^ther, there are "56 uniqiie 
combinatXQns of eight packages, taken three at a\time.: 

' we would need 56 people, zo exhaust all the possible 



J 



^K.X;^ Sirotniki- "Introduction to Matrix SampliW 
' For , The Practitioner," in W, J. Popham,^Ed., Evaluat^iori 
in Educat>ipn , Berkeley: McCutehan^ 1974, pp. 451-530 . , 

/ Importance w^as. defined operationally as "maximizing 



the differences among gjfoups. 
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combinations of packages we ^Jlanned to administer ^ to 
each stratum in the survey. , ' ^ * 

We also entertained otl^? possibilities (such as 
Ibst^ntlklly more 
each st^^tfin) but rejected them because t:hey would either 



drawintf silbs t^ntltlly more ot less than, 56 persons from 



make "the , survey "too experlsive 'or provide' insufficient 
information. Finally, 5^ per 'stratum Would -permp.t mean- 
ingf uL^esults even i'f the rate of retifrn was as low as* 
.67%. Irv^fact, usable responses' have' been ^^ecured from 
just^over 71% Of t3ie sample,. 



^ ADMINISTRA.TION 'OF-^THE SURREY - . ' ^ . > . ^ ^ . 

^ ^e-.sougfcb td as»ur^ a 'high rdturjnT rate ^y. various . 

a(^minist'rative'^tra'tfegie^'.*''' E^i;^ exSimplp',. me^erS; of 'the • 
•pFb staff attended ^eacfi^gf^' the ^regional ^mee»tings' of the 

brou^ on Medical Education during ^he Sgrij^gVpf 1976. to, 
' explain' the.' survey and haw itfcwo^uld be 'cfondticte^W 'But 

most importantly, we.v^re assisted by coprdifrsrare ' at 
, each schopl who. distmbut$d--anS' collected^ the '$ui:vey ' $ 

mafcerXaXs^^^atuij&ent^^ requests,' as* necesfi'ary. 

. ^''The iocal AQO^dinator -vias Vominatdd, ?^y ..the Dean at 
ea.ch 'schqol. We^ 66n£agted .these; fiomthees Jand <i^«cribed 
the kinds of* etat^vities expfec<ted 'o^f them .alad, ^plained 

• "(jhat their rf.irst' f:ask would be to revijew the Iflsb ol 
respondeHt's' at t-heiif .^schools to* yerify> that e^ich .was ^. 
i.ndee^d on the facullj^,. taught .Undergraduate ^medical . ; ' 

'stucJenl!^, ai:>d had Ipj^en correctly identified; according 
to *their rank^^ ^nd acadeftnic (iepartiiieiit ^ . ' , ^ 

Through thjs revieW' wfe' fpurid thkt a, number of those' 
priginally cJraWn. f or lOur sample' rie^ededt to be re{)ladfed. 
We drew additional , names ,' repeated the- verif.ic^tion^ pro- 
cess, antl came up wi£h a^ sample*;that"was r'epre^entative 
oJE the teaching faculty at United' Statefe* ifiedical 'schools .'i 
'The respondents- .'J:)Tfat, had-;been . identified by this process 
were sent lette^a'^a week before "the Purvey materials' ^ 
arrived explaining the, project' and afeking fpr their coop- 
eration. * . . . • ' . ' , * 
^ , *> ' . . 

The packets* for each respondent (''the coniinon package ^ 
the thiree additional packages , instructions , a^d the 
envel^opes and pens needed to' complete and return the,' 
packages) were assembled at QfD and^ mailed to ihe cteor- 
lii'nators wha then handled- the internal distributipn at 
their medical schools. At .th^' %ame time, tK,e 
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* coordiijator^ were sent sets of follow-up reminders to.bq 
sent to ^spondents whcj *had not returned their completed ; 
materials by speci^ed times, along with instructions^ on 
how^ and when to sena them out. , ' , 

' * Everyone — the Deans, the '<:oordxnators , and the te- 
spond-ents--was told that appropriate precaution^ were 
being taken 1;o establish and prese;fve^*responden^t anonym? 
mity. For exampLe, we asked respondents to h^nd carry' 
t'heir completed, pealed packets, to the coprdi'natpr ' so ' 
that -their names could be checked. off (ana they would 
/ thMS not be sent. reminders) without Having to write any i 
1 identifying marks on the returned material. Usi,ng this ' 
\ procedure, we knew who had returned materials without ^ 
knowing which packet ^was whose/ The completed packe'ts 
were ^mailecj by the coordinators to DFD, where they were 
logged. dn and entered into the computer in preparation 
far analysis: • 

In logging in the data and entering it, into the 
computer, we checked for a variety of errors*, illegal 
'responses (such as picking two ;aJ.ternatives in ^orced- 
ci^oice questions^ when only-one choice was allowable;), 
key-punching and 6ther\data entry* errors . These ch^ks . 
were done both manual^ and when possible, by machine 
,and identified errors were verified by checking the ori- 
-ginaJL response. ..If the error was djje to data entry, •it' 
was corrected. If it was* an error made by the respondent 
it was coded as "bad data." 

* ^ • * * 

We also verified a random 4% of the data comparing 
tftfe information in our data bage with the 'raw *data in the 
pe^rned booklets. , This was to determine -the rate of 

• "subtle errors" which were not gross enough to be picked . 
up -either in", the scan during data logging or by our data-- 

. cleaning computer programs. If the error rate had not 
been acqeptdbly low, we wouTd have had' tq verify each 
item in ,©ur computer da'ta base. As it turned out, the 
error rate was abSut 1% and we, did not need^to review th.e 
balance of the data. 



• ,^ALYSIS OF THE DATA • ^ 

The stratified random sampling procedure and the use 
of written simulatigns created analysis requirements , 
which precluded the use of available computer programs . 
Consequently, special programs were written. These 
programs attended to the particular features of our. 



stratified,* sampling procedure, so that we could gener- 
aii;-2e appropriately to the full -population, ^ and the 
scoring requirements of ' the -simulations *so that /data on 

.routings. ^ woij^ld be provided. The .ana'lysis begap. in 

February, 1977 "and was done on the 1910 sets of 'usable 
data that Were available at that titne.* 



STATISTICS USED IN THJS REPORT 

The findings in thi?' report are presented as two 
types of percentages, as explained below. Most findings 
are presented 'as estimated, .population values (estimated 
parameteVs) ; that is, the proportion of all 28,393 full-- 
timfe teachers* of undergraduate students in u!,S. medical 
schools* that we estimate would have selected a particular 
route if we had qonducte;d*a census rather than a survey. 

Generalizing f rott\ survey responses to full popu-la- 
tion' estimates requires speC^'^ficf jcalculations , based on 
the sampling prt)cediireS;' Fot example, a sample 'of pro- 
fessors in basic science departments at small^ private 
^schools} represents/ a population of 234 persons. ^ A sam- 
ple of professors in clinical departments at l^rge 10* ^ ' 
^public schools,, by contrast, represents a population of ' 
1220 persons, *In both cases we randomly selected 56 
people to part of 'our sa;nple, a'nd usable^, responses 
were received from 39 ^ersoris in the first *group arid 4 3 
in. the second. As can be seen, a percentage of the %9 
.i:espoh4ents who. selected a particular ^opTtion does not 
tiave the* same implications for the full population as 



^For a fullar discussion of this issue, please see 
the next section of this Chapter,. . * 

°Which incTudes consideration of both the particu^ 
lar options Selected and the order in which they are 
selected, w * * ^ - 

Defined a^ having an ^entering class size of less 
than 100 students,. (There are 36 such schools) 

* * ' ' , * 

• l^Defined as havi'ng an entering clas^s^si^e of 150 
or more students, .{There are 3,4 such schools) 



the* percentage of the 43 who selected that option. ^ The 
statistical pfocedure^ ^used for conversion from sample 
results' to population findings aire standar^J, as described 
by Cochran.^l . - ^ • • 

Although the more usefyl findings of this survey are 
those for the f ulL^ population , frequently interest and 
clarity are enhanced by tHe pre'sentation of findings for ^ 
particular groups of respondents. For example, in each 
simulation it is useful to know both the estimated pro- 
portion df the population that would^ select a particular. . 
option ^nd the actual proportion of respondents that made 
a particular choice , in the face of particular circum- 
stances. To Illustrate:' it -is estimated that 15% ot the 
'full pofjulation has attended workshops brt clinioal super- 
vision. Of t^iose respondents who did attend, 8^% founct ' 
the experience valuable. Th^ 15 is a population percent- 
^age. The 87 is a sub-group perc'entage. Both can be 
useful to know, As a consequence, two types of percent- 
ages are used throughout this^ Report', and are dxstj.nguished 
frpm each other as fol?lows: 

1. Estimated po^^ulation percentaqes are always pre- 
.ceded by the symbol {#)•, so that "#61%" should be read as, . 

"an estim^t^d 61% of the population of U.S. medical school 
faculty'. members that teach undergraduates.. . .." 

2. Percentages of 'sub-groups 'of respondents are not 
preceded by any symbol, so "that "61%" should be read as, 
"61% of the group under ^consideration. .. " 

Frequently both types of percent^'ge<s aVe presented, so 
that bo.th the proportion of respondents and the implica- 
tipns for the full population can#be readily seen. 
Standard errors associated with estimated population per- 
centages are repor^ted *at ' the end of each of the six 
chapters presenting findings for the simulations. 



INTERPRETATION OF RESULTS OF SIMUii^IONS 



MU^^I 

umrrari 



Chapter 2 of this Report- sumrnHrizes the key findings 
from the "forced-choice" patkages and presents ho special 



Hw. .G. Cochran, Sampling Techniques , 2nd edition 
(New yprk: Wiley, 1963), pp. 106-107. • ^ 
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difficulty in interpretation. Chapters 3*8, hovever -r- 



report findings from the written simulations > which are 
data collection devices that depar,t considerably from, 
conventional survey instruments,, and require expla^' , 
nation of how to .interpret the results. These results 
are reported for the population as a whole'' (all full- 
time faculty members at U.S. medical schools who teach 
undergraduate students) . / / 



^ ' - Most of the findings are reported as percentages 
Ipof the population that we estimate would choose each/ 

* option in each simulation'. Additional results iifvolve 
linkages among options within a simulation that are 
called "routes". Routes are pathways through a simu- 
lation, and include a particular set of options, in 
"any order, a particular sequence of options, or both. 
Tile discussion t^elow will help with interpretation of 
the findings from the simulations. 

Figure 1 is a flowchart - showing the responses for 
one of the simulations. ^ The blocks in, the dj^agram cor- 
respond to sections in the simulation — a paragraph or 
''two of prose .followed by sources of infji^rmation the 
respondent might wish to use and/or ne^t' Steps in the 

* solution of theV^imtilation ' s problem the respondent 
might wish - to piR-sue*. ' 

» Each simulation begins with an. "opening scene" 
(designated as Section "A" in' the flowchart) . In 
"Reseoirch Supervision", the cJpening, scene is: 12 



'.RESEARCH SUPERV<SlON ' 



- * r . "-ool his n-titu'^ D ,1 '■.'•r p^, of n ^,jir. 
^ j\ thr».^> you A,U Syf^^fi ' , t' 



% 

12r 



ContJ^d, 



•This section from the simulation, reproduced * 
differs .from those used in the survey in that 
responses to, the options in the survey were presented 
in the "latent image" form; .that is, the responsies 
next, to the selected^ options (such as "GO TO SECTION 
J" in Al) were not visible to the respondent and had 
to be devefloped with the use of a "special pen. 



11 
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FIGURE 1 TOTAL. POPULATION RESULTS FOR "RESEARCH SUPERVISION" SIMULATION (Nunters are estimated percentages of 
the pop.ulat1on selecting the option Irvdicated.) 
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Opening scene of "Research Supervision" continued: 

\ 

» Jim nas recently comDieted a brtel course entillcd Intrc^iuction o Rese^fc^^ ana the ScK^ntific 

, ' 'Metrod t^^o ^js oeen to d that good -researcM begtns wtth i •* v cf the uertm^nt literature When 

v'm cjmes lo ^ S ti'^t mppfinq you Dro^'ide hirn a th a'ctlrf' -it ui^c '0 hcip fjirrt reorn h s l.terature ' \ 
st*arcn '/. {h n "vo ev'***; re isno prepare nn TnnoM^ed biblugri^rhy \ ,our ft v Y.u' tjskb nr- f 
top.jluatt J"ii 4 Ljibiic/jrjcihy to fj^ve htm feedoack jnd''u < r^inge .vhntevpr ' ud instruction 
IS apr>'opf Ale 'jetorft hP begins his dctu.ii f^js^'i'cn A/Ork v.,!n ^ou 



You would now (CHOOSE ONLY ONE) 

A1 ^ncourdor Jtm !5 Oegrn and tq^onlact ' f o TO STCTlpM J ** • 
you 1^ hi' has any prjoicnis Other/»ise ^ 
you .v.lt see him m (mo wvfeeks 

A2 Encouf^ ]e Jtm lo bfgin and arrafige to * CO TO SLCTiON T ^ 
meet ^iin him alf r onp week to re^irw • • 

h;s p'ogr-iss 

A3 Diclj Aitn J'm your i.'xpe'J Jltor^s tor GO Vo bciCTlON P * * • 

riis /. o'f r 1 thfS j^^fiignment * ^ ' 

A4 A ,K.|Jim lo d 3CU':.', ^ls bi'-kc;f^junn ri .n ' CO TO ^^'CT'Ci D * ' 

'» t.Tf: '►.tinq irrl c :>""lUf tir.g rr",r irr n 

,A-^ M3k . -n ' r,e r>as any -■ju'^siion'^ b^foj^,. mi . 'TCTiON M " 



_ The options in the opening scene '(designated by the 
numbers 1-5 in the opening scene box on the flowchartl^) 
'each lead l:o a different vSection, as revealed to the 
respor^derit when a choice is made (e.g., GO TO SECTION J). 
Each clonne(5tion between sections is represented on the 
flowchjart by an arrow from the option number to the box 
representing the next section. * , 

^pte that respondents > dO' not move through the sec-' 
tdonsjin alphabetical order; the letters serve simply as 
a cievjlce for identifying sections' and bear no relation^ 
^ ship to either the content of the sections or the c^rd^r 
in which they are sele(|ted by the respondents. 

MQst arrows. 'on the flowcharts are interrupted, by 
^ numbers. For example, in Section A, option 5 has the 
number 21^ associated with it. This means that we esti- 
mate that #21% of medical faculty members would choose 
this option ("Ask Jim if he has any questions before - 
beginning^) if we were 'to do a census. Thus, approxi- 
mately #21% of the -population would move \from the 
opening scene (Section A) to' Section M, a^ bridge section. 



r 



1 o »# » 

■^-^Numbers do» not always appear in ascending order in 
the flowcharts though they do in the simulation booklets*. 
'^The departures from natural order were used to simplify 
the flowchart layout. 
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Bridges are a mechanism for Sirectina respom3)ents from 
section to' sectipn an^ on to a 'pointy whiclj enSs the prob- 
lem, as shown in the following example:^ • ' ' 



.SECTION^ 



Jwri asks whether you want his bibliography to follow a particular lormat. You tell him he can ' 
use the citations in the article you have yiven him as a gpide He has no further questions You would ' 
now (CHOOSE ONLY ONE) % ^ i 



• Ml 



4 



M3 



Encour.^ge him 'to»begin and to contact 
you if he has ahy problems Otherwise 
you Will siee him m two weeks. 

Encourage him to begin and arrange to 
meet with him aller one week to ce\^iew 
hi^ progress . 

Discuss in greater detak^ your expecta- 
tions for his work on this assignnpent 



M4 Ask Jim to discuss his background 
interpreting and conducttng research 



Not everyone reaching^ Section M woul'd seli^ct the 
same option. On the, basis of 'the survey responses we 
estimate that #9% of the total population wou^d ask the 
student* to begin wprking and^ scheduTe a .meeting with him 
in a week (option M2) . The value, #9% (indicated simply 
as- "9") can be found on the flowchart in the arrow undeF 
the number 2 — corresponding to the- option M2 . 

The total percentage of people "entering" aay sec- 
tion equals the sum of the values exiting. This. c|in be 
seen in Secrtion M where #21% of tHe population enter/ and 
#21% leave (6'+ 9 ^'3)- 



Thife equality Sttt^y be obscured, in some cfiises,- be- 
cause the options leading to a -section are not always 
readily apparent. One way in which this may, happen is ^ 
shown in Section's, where the arrows have to be back- 4 * 
tracked some distance to identify all the respondents 
who enter tfiat section.' The second way is seen at Sec- 
tion E, which ^appears to have only #5% entering , by one- 
option (S7y yet #7% leave. The remaining #2%' come from 
option 6 4.n Section G at the right hand side of Figure 1. 

^ A symbol (^ ) is used at G6 to 'keep the figure from 
being bVerl^f crowded -by lines. i;he* letter^ irl^ide- the 
circle indicates the section to v^ich the option leatds 



4nd the arrow head points in the general direction 'of 
that section. - , ^ 

The equality of percent entering and leaving ^ 
"^'^ci^ioiv may' apjgear n ot' to precise. In Section U, for 
example/ #131% of the population^ enter (#5% f rom N8 and 
#6% from OlOj and fl2% leave (#1% via option 6 and #11%' 
thrCugh\option 8) .^ This seeming discrepancy is 'dtie to 
rounding, error, attribut^able to ^he. computational pro- 
cedure^" used in anaXyziq|^ ^he da^a.! / 

Option U7 differs^ frojn others describ^ed so'far.^ 
Specifically, any respondeni!. Who selected the option:- 

U7. Briefly describe the research * 

you are conducting. ^ > ^ 

would h&ve developed the following response: 

* Jim appreciates this background and , ' ' 

says he is anxious to begin the actual 
research pha$e. MAKE ANOTHER CHOICE, 

T^e phrase MAKt ANOTHER 'CHOICE is the ^ instruction which 
ti>rns respondents back and asks them to. select f torn, the 
remaining options.- Oo the flowchart. MAKE ANOTHER CHOICJ; 
is indicated by the U-shaped arrow ), as show^y under 

option U7. 

Some sections, such as^ Seation E/ have only- a sin- 
gle arrow leading out of th^m". In these, cases, all 
respondents are directed to a specific section (e.g., NOW 
GO TO SECTION B) , as shown in the following example: 



incii.nte o\ the f.jilu^inq un^tc. ynu wou'du' .sow'^A)',i^P\u(i'■ m a ' ^^ussla^ vwf-^ Jim 

>i , ■ • • ijN ^ns f')r tn b.u',..qMphv CINDICATE YOUR CHOltrROR EACH ITE^ BELOW) 

* - Ni'U AN V '.vTl ! APf'FAl TO REC ^ 

YOUR )EClblOrj Crj EACH ITE*^" 



r 1 Th(> type's nf sourcrs Jim it»otiUl u' 
, ^-t* "^f^^d^rmj' J fn -should u^n m the .innoM 



Would lnciu(J<? - WcMid Not Include 



LI T^iP rrU.v.i'^0'"nf Jf'^ liUi/.lturi' SH.K'-h tQ^ 
his ^rh on !ii.^,^)r(>|f.f t * 



ri^i- fmporMm o of iclentilyinq kry cont'o- / • : " ' ' ^ ' 



' V Cont'd. . 



Section E continued: 



The depth of rpsM^uch you expert to spp 
reflected m thp mnoiation's 

E6 The btjnd jfdi, you will use to rv.itu.ite biS 
F7 The F^umber of citations hoshpuir) mrlu^"''* 

i • 

E8 The relevance of thi^ assitjnrnf nt to his 
future as a physician * 

N0Wr<30 TO SECTION B 



I 



Note that Section E represents one kind of "shopping 
list" — a section where the respondent *is asked to make 
a response to each indivrdual option. A second kind of 
shopjJing list section is also used. ■ While the first 
part of the section gives the respondent ^^list of op- 
tions io choose among, the second asks him/her to select 
an. optioji which leads to another section. The following 
is an example of such a section: ' 



J'o'jf (CHOOSE AS MANY AS ARE APPROPRIATE IN ANY Oi^OER) 



J 1 His DpiDion of rt'SL' kc ri tn iji ri'-r.ii 



0^0 



[)? His ^jnor exp('r.'fnn<> nndin-j ,^1'nt.iH 
'irtii^ftb and r^'ports -* ^ 



His trj.iri^ to ♦nt.Tftf. i^fei pf>H ii i 
tion 



D4 His reasons fot sei^t t.r,^ ifn \^\\\^ \,' ^t 
research topic 

05 His expectations for this nnifvc ^ 



Cont'd. . . 




Section. D continued: 



'In view of this discussion, you would ntfW^CHOOSE ONLY ONE) 

06 Encourage Jim to begin and lo contafcl 
vou 'f he h.is any problems Otherwise 
you wi^i see riim m iwo ^eeks 

D7 Discuss t^ith Jim your expectations for 
his work on this assignment 

' 08 Encouratje Jim to beqm and arrange to 
meet v^ith him after one week to review 
his progress t 

D9 Briefly describe the tesearch yc^are 
conducting 



D10 Review with Jtm the ma)or steps m the 
process of conducting s^tematiG re- 
search 



' Since only D6-D10 require t\e respondent to choose 
one of a number of options, they are the only oTies rep- 
resefnted in the flowchart. Percen,tage values fpr the 
options in the shopping lisif" portion of the section are 
reported in separate tables preceding each flowchart at 
the end of each chapter. In the ca3^ of Section D,^the 
table looKs like. this: 



TABLE 1 " ^ • 

Example of Reporting for a "Shopping List" Section From the 
Simulation "Research Supervision" 



TOTAL POPULATION 


SECTIONS 




TOTAL 


DESCRIPTION OF^OPTIONS 


C 


D 


S 


lu. 


1 Opinion of research ' 


r 

7 


12 


3 


7 




29 


2 Prior experience reading 
scientific articles 


7 * 


13 


5 


9 




' 34 


%3 AbiliT:y 'to interpret technical 
information ^ . ^ > 


5 


io' 


2 


6 




23 


4 Reasons for selecting topic' 


9 


17 


4 


10 ' 




40 ■ 


5 Expectations for this Qourse 


9 


1.6 


4 


10' 




39 



I 



17 

20- ■ 



5?« 



J 



Section is one of the four parallel sections 
giving the respondent the opportunity to discuss the 
student •s re&eafch backgrcmnd. These sections are 
parallel in ttiat the options in C ^are the samfe as" in 
D, S/ and U. Thu? values can be added, acrgi^y and, for 
example, it can be ^estimated that #29% of the popula- * 
^tibn would like to^ know the 'student ' s opinion of 
research (under th^ circumstanaes of the simulation) 
when supervising this kind of student activity. 



Thos^ sections which ask respondents to choose 
first among '"shoppiing list" options AND THEN branching 
options will* tend to have parallel forms only foi; the 
shopping. list portion (as reported in Table l)t These 
se£:tions"i^ave different options in the CH60SE ONLY ONE 
set of options. Note, for example, that there are 4 
such options* in Sections Carid S, 5 in D, and 3 in U. 
The point*' in the simulation where each section^occurs 
accounts for these differences. The appropriate "next ' 
s.tep" depends on where the resp<3'ndent is in hife/hfer 
solution of the simulation's problem, and that position 
is. reflected in the' number and character of the CHOOSE 
ONLY ONE options that are made available. 



Finally,. the symbol \^ is used to indicate that the 
respondent has reached the "end of'tlie problem." In the 
case of "Research Supervision" thei'e is only one 5pP a 
(located at the l^wer right-hand corner, of Figure^*l) 
while in o*ther simulations there *may be several points 
at which the problem can end. Note that EOP means that 
the respondent haS come to the end o€ his/her approach 
to thq^ problem's solution, not that all the sections 
available in the booklet have been considered. 

There is one other consideration in interpreting the 
"results 9Ji,an qption-by-^option basis. In Figure 1, for 
'^Research SupervtTsion" for example, we see that #1% en- 
tered SectidmiS via Option Fl'and #4% by D8 , but we. 
cannot tell Im^ these two groups of 'vrespondents proceeded 
subsequently; ^ bq^ groups become "mixed" at this point in 



•'■^Barallel sections are necessary in the design of 
the simulations whenever there are a seraTes of steps that, 
can be" followed in various orders. This design feature 
makes -itr possible to know the particular sequence select- 



ed by the r'esporident . 
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the analysis. It is noti^possible, therefore to deter- 
mine* from that figure w^at ^j)ercent oi the population 
selects any given totaT roate through the simulation., 
For that, a different analysis Of- the routes themselves 
is necessary, and is* reported separately in each .chapter 
and, when appropriate, represented on a separate Figure. 

REACTIONS TO "THE SIMULATIONS • - 

When respond^ts reached th§ EOP , they were asked 
to turn to a "Tail^sheet;, " locat.ed inside the back cover 
of the booklet, complete some questions about' the 
simulation and the way- it relates to their teaching re- 
spOnsibili'ties.^ On the basis of the findings from 'thcjfee 
questions-^5 we are able to draw the following cdnclusions: 

' 1. The different simulations were perceived. con-' 
sistently by the respondents. Specifically, 'the 
responses to the questions about each simulation were 
very ^ similar to the responses about Sach other simulation, 
although no one faculty member^ responded to more than 3 
of the 6 simulations, and many responded to only 1 or 2. 

2. The simulations have high Vface validity. Re- 
spondents reported" thaj:. tffe simulations are realistic .and' 
allowed them (the respondents) to show how they actually 
handle similar iflstruction and inststuction related prob- 
lems. ' \ 

^ <i. The simulation format works acceptably. Re- 
spondents iindicated that they understood how*T:o use the * 
simulations and hed little difficulty wo^rk^'ng through " ^ 
them. (This is confirmed by the finding that fewer than 
4^ of the responses were blank or improperly executed.) * 

4. Most faculty members found these simulations on 
in'structional 'problems sufficiently interesting to indi- 
cate their interest in working on others. 



CAUTIONS , ^ . ' * ' 

On the basis of, the procedures u^ed in this purvey, 
we ^feel compelled to provide three cautions about the 
results presented in 'this report. 

,1. The tesultp are based on* pencil-and-paper self- 
reports, which may not be a fully accurate reflectio^n of 

. I 



■'■^Repojp^ed- in. detail in the Third Preliminary Re- 
port , July, 1977. 
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^. what' people, actually do wrfen they teach; therer may be a 

♦ discrep^ancy betveen what our respon<lents say they, do and 
< A what thqY actpally d'o under 'the*"p«»es5ures of real teach- 

ling. We did sbtess .that we Vere 'seeking reports of 
/ actual teacher behavUor^*by including the following in- 
^ ^struc^on at the start of each simulation: , "Your task 
ii^-^ chobse the optionCs) ^which^best reflect (s) what yau 
^ ,wou^d actually do if ypu >*ere faced with that problem in 
the teaching ^pu do. " Yigt, we^'recognize that 'under real 
' world constraints^ it-^is possible tliat a teacher' would do 
one thing (or. not 4o another) wfiich s/he would do dif- 
feirently if raore>time w^re ^available or other 
opportunities 'were' provided^ and self-reports might tend 
toward the lattier rather ,thaQ the former/ It is.prob- 

• ably best t6' Interpret the reported results as either 
an estimate of the "upper bound" of teaching in U.S'. 
medical schools, or as an estimate of what faculty . mem- 
bers thin^k they should be ^oing. Wq have concluded, 
however, that there is tio^reason to suspect purppseful 
distortion; • there are tpo many excunples of instructional 

, behavior reported that are not consistent with so^nd 
^ instrucStioncil grinciples. 

^ i 2. The results reported reflect both the feelings 
of the resppndents and the measurement pfocedures, for- 
mulae, statis.t^ical assumptions, etc., used in designing 
and executing the study., To the degree that certain > 
. .kinds of information qcui be^ collected using forced- 
' cho 1,(5^ questions', and described using percentages, our 
results can be used for drawing conclusions about the 
popi>lati6h of teaching faculty members. 

3. Since we collected small am^nts of data fi^om' 
'each respondent, and since we dealt ^with a limited num-. 
ber df respondents at each medical school, we did not 
(and* will not)* report oyr findings on either an indivi- 
dual jpr school basi^. We did not collect enough 
inforiaation to warrant our vdrawin^ inferences at either 
of these levels. 

■■ 

Within the constraints of these three cautions, and 
given the procedures we have described in this ctjapter, 
we are 6ati^f ied that the findings in the Report are in- 
teitpretable and meaningful. 
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' 11* V.S. MEDICAL SCHOOL FACULTY - AN OVERVIEW, * 

' . * , ' • ^ y . ^ 

This Chapter presents descr:iptive information and 
-general finding^ from the- suirvey ' of full-time facJulty 
members' who teach undergraduate Students , in United. 
States mediftal schools. As explained*^in Chapter I, the 
statistics reported 'are estimated percenta^*es bf the * 
total population of 28,393. The areas of focus are: 
demographic variables (age, sex, mobility) , preparation 
for teaching' (courses taken, worksh6ps attended) , teach- 
'ing settings and methods,, and educational issues (from 
whom assistance is sought, experience with Mew develop- 
ments in medical education) . ^ 



DEMOGRAPHIC VARIABLES 
A. Agje 



Table 2. presents the percentages of age groupings 
for the total population. There are essentially no 
differences from this age sprfead pattern among members 
of b^sic science or clinical departments. There are 

' TABLE 2 
Age 

55+ 45-54 -35-44 25-34 <25 

_ ' #1216 ' #26 #39 #23 #0 

differences, iri expected directions, according 'to aca- 
demic ranks: only' 21% of Professors are below age 45, 
while 61% of Associate Professors and 87% of Assistant 
Professors are. Conversely, 32% of Professors, 8% of 
Associate Professors, and 2% of Assistant Professors are 
55 or older^ 



^^See Chapter I, p. 9 for a» explanation of the 
two types of percentages (with # for full population; 
Without # for sub-groups) used in the report. 
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- B. Tenure ' * ' - ^ 

Forty-^six pero^nt^(#46%) of faculty members^ hold 
academic tenure. TKe^?elationship between t:his variablfe 
and^ aca'demic rank is as Expected: only 10% of Assistant 
Professors hold tenure, ^\ihile 66% of Associate, Prof eseors 
and '91% of Professors do. ^There is a relationship be- 
tween departmelital affiliatioij and tenure: 55% of basic 
science faculty hold tenure, while only 42% of full-time 
clinical faculty .do. Possibly, t]iis may be explained by 
differences in the way tenure is granted in the two areas 
(in lieu, of salary pr on a different tiiAe. scale) , a ten- 
dency for .promotions to ^e granteid earlier in the basic . 
-sciences, (see C, below), or a tendency for some .physi- 
cians to interrupt their full-time academic careers with 
periods of c^Tinical pjractice. 

C. Academic Rank ' • ' 

Table 3 presents the proportions of faculty at each 
academic rank. There is a relationship between rank and 
departmental affiliation, which parallels the relation- 
ship between department and tenure (see B, above). 



TABLE 2 ' 

, Academic Rank . -f 



' . Inst. & 

Prof. Assoc, Prof. Asst. Prof, Othys ^ 

#29 ' * #24 * , " #34 #14 

Among basic science faculty 58% are Professors- or Asso- 
ciate Professors, whiie among clinical faculty 49% hold 
these ranks. t • " 

D. Sex 

' The large majority of fyll-time medical school fac- 
ulty menders are men (#84%). This proportion is the same 
among basic science and clinical faculty, but Varies 
according to academic rank (T^ble 4). The 'inverse rela- 
tionship between academic rank and the 'percentage o^ 
faculty who are female might' be • attributed to one or more 
of the following; the smaTl number of qualified female 
graduates available for academic appointments until 
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recent years ^1*7 a tendency ^or more women than men to 
postpone and/or interrupt their progress On the career 
ladder,' or differential treatment of men and women in 
the promotion process. These factors were not 'investi- 
gated in the study. ^ 

¥ 

- ' TABLE 4 
« * ■« 

i>ex of Faculty, By ^ank * 



Professors (#29%) 





Male 


Female 




95% 


5% 




8,8^ 


12% 




82^ 


18% 


(^14%) 


62% 


' 33% 



E. Teaching ' "Load" ' ' ^ 

The number of" weeks per yeaff and the number • of 
hours per week that full-time fapulty members spend with 
medical student^s are summarized in' Table 5. It is empha- 
sized that these finding^ do not include the time the^e 
instructors may spend teaching graduate, studen^is, house 
officers, nurses, or other students, qr pursuing other 
^responsibilities (such as*patient care, research) or • 
administration) . It is striking that nearly one-third 
(#31%) spend less than 10 weeks per year, and more- than 
one-third (#35%) spfend less than 5 hours per week teaching 



In medicine, for example, prion to 1967 there was 
only one year. (1950) in which the proportion Qf female 
graduates, of U.S. medical schools exc^ded 6.9%, so the 
#16% of faculty members that are female exceeds that part 
of 'the pool, with ^Ite increased numbers in the lower ranks 
possibly reflecting a recently enlsirging pool and the ef- 
fects of "Affirmative Action" programs. ' (Datagram, J. of 
Medical Education , 48:. 186-189, 1^73.) > ~' 



3. 
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Hours per Week 



TABLE 5 - ' 

Hours Per Heeir\dnd Weeks Per Year 
Spen^ Teaching Medical Students 









• 5-9 


10-14- 


15+ . 






All 


#35 


#29 


,#18 


#17 




Weeks 


Per Year 
















<J1 


10-19 ■ ■ 


•• 20-29 


30-39 


40+ 




All 


#31 


#20, 


"#12 ■. 


#10 


#28 


Basic 


Sciences 


30 * 


35 


20' 


) ' 


6 




y ini cal 


30 . 


^ ' 13 


9 -J 




37 



medical students.. .Further,, it should.be noted that 
, almc^t two-rtiiirds (#64%) of the- :faculty teach medical 
students less than TO hours per -week and more than helf 
(not necessarily 'the aam«' people) teach less than 20 
weeks per year. It is also noticeable and understandable 
that clinicians tend to teach year-round (more .than 40 
week^l^onsiderabiy more than basic scientists ( 37%* 
vs. There are virtually no differences in teaching 

"load" according to acad'emic rank. 

F. Mobility 

Contrary to popular assumptiop's , U.S. medical fac- 
ul'ty members are not typically on the move- bfetween ^ ^ 

r institutions . The iarge majdrity (#68%) have held a 
salaried appoihtment at only one school and #58% have 
been at their present school five years or longer (Table 
6)- Sixty-^five percent (#65%) of faculty "have held 
salaried academic' appointments at medical schools for 

,five or more years. There are no differences of any 



^^Not all faculty who tekcb less than 10 weeks per 
year are the ones who teach less thath 5 hours p^r week/ 
The correlation between these two groups is 0.47. 
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TABLE 6. 
U.S. M^ical Faculty Mobility 
No. of Medical ' Schools at Which 

Salaried Appointments Have Been Held: - ^ f 

.:''#68. ' #23- .#7 #2 #1 

No. of Years as Salqiried Faculty at 
' Present Medical School: 

^ 1 1>4 5^v>i> 10-14 15-19 2Q^ 

#5 #37 #32'. #12 #7 #7 

^consequence according to departmental affiliation and 
variations 'by rank follow the expected pattern: #21% of 
professors, #11% of associate prof essors , ^ and #3% of 
assistant professors have held appointments at 3 or more 
schools • 



PREPARATION^ FOR TEACHING ^ 

It is generally felt that securing competence in a 
field or disciplihe is a necessary part of preparing for 
teaching. In contrast, only recently haVe any- medical 
faculty member^ considered it n^e$sary or desirable to 
complement that preparation with efforts to develop their 
instructional effectiveness. Indeed, only in t?ie past 
decade ^have instructional- development opportunities 
(courses, workshops, seminars), begun to be fair]^ widely 
available. . - ^ . . 

Almost^^no prior data are available* for comparison 
to the findings. of this survey. The only known data on 
faculty efforts to secure htelp in preparing for their 
teaching /ypef se, come from' a study conducted two decades 
ago. This studV found that virtually no one in a sample 
of 350 teachers *at 7 U.S. medical schools had undertaken 
any special preparation for- teaching. Although the, 



^/H. Jason, *"A Study of Teaching Practices at ^ 
Seven Selected U.S. Medical Schools," .Unpublished doctora 
dissertation. The University of Buffalo, 1961. 
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subjects in the study t\ad not been selected to be a 
representative national sample, }:he finding >was probably 
indicative of the* national situation, Consic^ring tHat 
almost none^f the medical faculty pursued systematic 
preparation for teaching 20 years ago/ it is striking 
to find that now #21% o| faculty have taken one or more 
farmal college courses on ^dvx:ation/teaching , #^39% ha^^e 
attended workshops or training sessions on instruction, 
and the majority of-s-those who were involved in these 
activities feel positively about' the relevance and value 
of the experience for their own teachingJI(Tables ,7 and 8), 

TABLE 7 

Preparation for Teaching: Formal Courses 



Have Taken One or More Formal 

Courses on Education/Teaching ^^21"^ 



View of Value of Specific Course(s) 
for Own Teaching: 



Topic 




Relevant 


Not Relevant 


Educational Psychology 


#15 






Instructional Design 


#13 


90 


Id 


Teaching^Methods 


il6 


87 


'fa 


Evaluation/Testing 


#14 


86 


■ > 14 " 


Sociologj( 


#12 


60 




Anthropology . ^ ^ 


# 7 '. 


61 : ■ 


39 



20 ^' , . ♦ ' ' 
Numbers, in this doluinn are estimated percentages 

of all faculty (e.g., #15% of fa'culty have taken a course 

in Educational Psychology) . 

21 . 

Numbers'^in this column are percentages of those 
faculty Who have taken a course on that top^lb- (e.g., 78?. 
of the #15% who tocik a "course op .Educational Psychology 
found it relevant) . ^ . 
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• , TABLE 8 ^ 

Preparation for Teaching: Workshops " 



^ Have Attended One or More Workshops/Tra1nl9e Sessions ort Qesign, Implementation and/or 

Evaluation of Instruction m the Health P/oftss1ons:, * #39X 



Time Spent In 


Workshops: 

1 


1 day 

- 7 days 

- 4 Meeks 

- 3 Bwnths- 

3+ tnonths • - 


59 

5 
4 


View of Value of Specific Workshops for Ovn Teaching: 






Topi c ^ 




^valuable 


Va.luable^^ 


insiruc Lioria i/LOUrse Design 


#26 


oc 
OO 


14 


Lecturing * ^ 


#13 


81 


19 


Small Group Discussion ^ 


#23 


' 91 


9 


Laboratory Teaching 


#9 


83 


7 


Clinical Instruct>on/Superv^sion 


#15 


69 


• 11 


Interpersonal Skill Development/Sensitivity 
Training 


#16- 


88 , 


12 


Evaluation of Clinical Performance 


#14 , 


91 


9 


Simulation Techniques * 


'#14 ' 


89 


11 


•development of Programned Instructlon/Self- 
InstnictionaNMatenals * ^ 


#21 ' 


37 


13 > 


Cofiputer Assisted Instruction (C.AJ.) 


#11 c 


74 


26' 


Use of Media in Instruction 


- ' #20 • ' 


^ 91 


9' , 


Evaluation/Testing* 


#23, 


- 90 


10 


* 












r 

* 
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'Numbers In this column are percentages of the #39X of f«:ulty who have attended workshops. 

23Numbers in this column. are estlwted percentages of all faculty ('^'iv-<261W ^aci/ky^^ave attended 
a workshop on Instructional/Course Design)* • 

or-, ^^^s column are percentages of those who have attended a workshop on that topic (e q , 

86X of the #2^X who attended a workshop on Instructional /Course Design found It valuable). 
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INSTRUCTIONAL SETTINGS AtfEfMETHODS ' 
A. Settigigs ' , ^ 

The setting in which instruction ocCurs can exert 
a considerable influence on the range of experiences 
available to students and, hence, on the qualify of 
.their learning. ALthough teachers can arrange exceptions,, 
it is generally tru6 that there are particular opportu- 
nities available in. each separate instructional setting. 
, For example, in a laboratory ^r a patient examining room 
"Opportunities exi^t*that tend not to be available in a 
classroom, and vice y^^sa*^ • • " 

Table 9 presents the -findings based on self-reports 
froAi medical faculty oft the instructional settings in w. 
y^hich they teach, for the totat-populatiorrr and according 
to academic rank'^and depa^lmiental aff-iliation. As ex- 
pected, most teaching qccurs in classrooms and conference 
reoms, ^^^ith the interesting finding that the^ inbidencfe of 
"frequent" use -appears to be relatjed to , academic rank. 

^ Ih^s parallels th^ finding for "frequent" u^e of lect;ur- 
'ihg, in Table 10* For reasons based on both suljject 

<^ matter and tradition; basic science teaching is distrfl- 
buted among the settings differently from the pa'ttei?n for ^ 
the'^ clinical sciences. , Of f ice-based ^teaching is fairly 
common, even ainong member's of basiq^cience defpartments 

' Not. surp3fi&ing, but perhaps disappointiTng,^is the. find- 
ing that basic scientists almost never t^ach in'*patient^ 
care settings, " * 

. B. Methods ' ^ 

tribute to a teacher^ s 
uction*^:^methods . ' Experience 
era, suggests that the most 

_ hod's appropriateness for 

the subje'ct; mat;ter,- the teach^r^f familiarity with th*^ ' 
pethodk, departmel^tal/in^itutional Expectations apd" ' 
traditions, clas^ksizq;|/ ^d available resources. Even 
if the^ selection of an iftstructronal' metllod is under its 
user's jcohtirolc^ .once selected, the method brings 
constraints .on the uses* to whicl) it c4^ be put. There ' 



^^Findincfs that bear on some aspects of how faculty 
members make decisions on these matters are presented in.*- 
Chapter VII. ' ' 




tabCe 9 

rnstructional Settings 



I 
I 



Setting - 


Response 


Total ' 
Population * 


Assistant 
Professor 


Associate 
t^rofessor * 


* »-> 
Professor 


' BasTjL 
SciaoAp 


. 'W> ^ . 

Clinical 


ClassrQom/Conference 
'j||[{oom 

W - \ 


Freq^^ - . 
Occa ^ 
Never 


^ #61^- . 
#33 
#5. 


^ 4. 


4 Ml 

'3 . 


' \ ■ „- 

f <», "7S 
23 • 


,T 

la. • 


*. V 

54 , 


Office 

J 
t 

~ — 


. ^' Ft:eq 

Occa'* 

Never 
^— 


#27 
♦#47 , 

■ #26 ^ ♦ 




- 24 
51 


21 


m . 

^ 21 / ' 

..t. , , , ;,„ 


42 / . ^ 
7 'v. 28 . . 


Laboratory \^ 


Freq 
. Occa ' 
Never 


' #26^*"' 

#30. 
#44 • 




■ , " - ■' 

^ 33 ^* 


27 f-. 
■ ^5 




" 57 . 


Patient Bedside 


freq 

Occa ' • 
Never , 


#33^ ' 
V20^^.,r.^ 
. #47 


32LV • 


.•<7' 




• 2' 
92 \ 


- 48-'' '' 
^ 26 

• 26. ' 7, 


Patient Examining Roomj 

J* ' * ' 


Freq 
• Occ> , 
Never , 


727^ 
#21 






• . 30 

23 

* 

- v.. 


1 . 
. 4. 

■ 9S- 


/ *39 . . . . 
^ 33 



I"* . / , " ^^Key: Freq = Teaching is dor!t ^EQUENTilY in this 'setting; Occa = Jeathing'is done OCCASIONALLY' if» bis setting; 

Ji^\ liever » Teaching is;NEVER done in this setting. ' ' , ^ , 



Fer^dU percentages- in tKis table tfW standard errors ^re^ or less. ' 
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TABLE 10 
« 

Initructional Methods 



Method 


Response 


Total 

Popul a tion 


Assistant 
Professor 


•Associate 
Professor 


Professor* 


Basi^ 
* Science 


Cli nical 


Lecturing 


Freq^^ 

Occa 

Never 


on ^ 

#36 

JO 






8 * 


; ■ ' 

s _ 


78 
4 


* 46 
44 

16 


























Small Group 




f Freq 


#65 








74 






54 


71 


Discussion 


























Occa . 


#28 


31 






a 




r 


39 


23 







Never 


fb 






' 4 

» ^ 


"3 






.6 * 


6 


Lab*o^atory 




Frep' ' 


#26 


C9 




29 


^7 






54 


U 


-'*Teachi ng 
























Occa 


#30 


27 




33 


34 






32 


29 






Never 




48 






-39^ 






14 


58 


Clinical Instruc- 




— t 

Freq 


Ir^ — 

^#44 


At 


♦ 




48 






3 


63 


tion/Supervision 












v! 




1 








, Ogcel , 


#17 

r 


1/ 






.15 






11 


' 19 






Never 


#39 


40 




4o\ 

\ 


" 37 






87 


18 


1 

Tutorial 




Fre^ 


#20 


16 




U 


24 






13 


22 


Instruction • 
























Occa -| 


. #47, 


48 




48 


51 






57 . 


43 






Nevpr 


#33 


38 




28 


25 






30 


35 


Programmed 




* > 
t 

' rroq 


f D 


5 




7 


7 






6 


6 


In$4ruction/SeTf- 
























' Instruction 




Occa 


#27 / 


25 




26 


36 






30 


25 


Materials 
























Never 


#67 


69 

8 




. 67 


' 56 






^ 64' 


69 


Computer Assisted 
Instruction 
(C.A.I.) 




Freq 
Occa 
Never 


#1 

Jf93 


0 

6 ^ 
94 


6 
*93 


1 
9 
90 


1 

11 
88 


1 

^ 4 

95 

— * . — 



^Key. Freq * This method is FREQUENTLY used. ' 

Occa ' This method is OCCASIONALLY^ used. 

Neve/ » T^is method is NEVER^used. ' ' ' ^ 
29For all percentages in this table the standard erroVs afe 2 or less. 
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are, for exalple/ instructional goals^ that can be more 
readily fulfilled in a small group discussion than in a 
lecture,' and vice versa. Indeed-, -the method used may 
sh'ap^, pr even determine, some of the^goals that are 
pursued. , . / 

Table 10 presents the extent -to which faculty in^ ^ \X:tr 
general, .and according to academic rank and departmental ^ 
affliliation, use various instructional methods, Lectur- 
ing> and small group discussion are th^ most commonly used ' 
methods, with the newer approaches of programmed instruc- 
tion and self -instruction still not in wide use. Computer 
assisted instruction is xkre. The ppittern o'f utilization 
of the various methods ||nong basic science, and clinical . 
faculty members is largely as expected. Theife is more 
frequent use of lectures and laboratory teaching in th^ * ^ 
basic sciences* and more frequent use of sm^d groups and 
clinical supervision among clinicians .-^^^ 



ADVICE AND ISSUES. ^ 

A. Seeking Advice ^ ^ 

One indication of the^.'itnportance that people 
attribute to 'an activit^;is , the extfen^ to which they 
seek advice or assistance, in the Execution of that- 
activity,. Responsibilities' wh*cl|p professionals consider 
'Central to thfeir wor]r-C§^y,' their^^esearch) tend to be 
discussed fairly of te|l\w4th cOllea^TI^s^nd others who 
may provide fresh perspectives^ and suggestions^ It^ is 
recognized that factors pther than perceivedjfeimport'ance 
ftiay influence tlie seeking ^of advice such- a^ the avail- 
abilifcy of appropEiate advisors', Jocal\raditions 
regaraing instxudtiOnal autonomy^ and risks associated 
with acknowledging ^ need for*l\elp. 

Questions *otfi patterns^of "advice-peeking" can also 
provide some indication* aif t^e value teachers attach tb 
various potential "advice-providers." Table 11 presents 
thejtfindings based bn^lihe responses of faculty members to 
the question,^ "How often cjo you seek assist^rK:e/advice ^on 
ins tructioi?ial"- issues ^nd problems fi^om the sourdes list- 
ed?"' Data ari^ not* presented according to professorial 
rank or de|)artmental Affiliation, as the findings for 
these groups do not depart significantly from the total 
population values. 




f 



I 



31 



ERIC 



TABtE. n 







Seek Advice on 


Instructional 


Pfbblems 




Source 


-Response 


Population 




Sourc?. 


Res-ponse 


' Population 


Facul ty 
Colleagues 
in Own D%)^. 


_ Freq30 
Occa 


^ #51 




Asst. /Assoc. 
Dean. for 
Educat^on^ 


' — ^ ■ 

. Freq 
Occ? 


^ #1 
#11 




Never 


#7 






Ney^ - 


#68 


Facul ty 
Colleagues 
Outside 
Dept. 


FVeq 
Occa . 
Never 


#12 
#62 
#26 




Current 
Students 


Freq 

Occa N * 
Never 


m 

#56 
#17 


Dept. 
Chairperson ^ 


Freq 
Occa 


#14 ^ 
'147 




Former 
. Students 


Freq- ' 
Occa 


#17 
#56^^ 




• Never , 


#38 






Never 


' #27 


Educational 
Specialist.^ 


Freq 
Occa 


14 . 
#24 




The 

Literature 


Freq 


' IS 1 

1^ 


n 


fiever 


#72 






Never 


#27 



^^y: F'req ^jfhis source is turned to ^QUEf^U. 

Occ^k'^Thls source Is turned ta/OCCASlflNALLy. 
N^er « This source is NEVER tufned to. 
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For all percentages in this table the standard error ts ^ or less. 
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It appears tha^t a large majority of "faculty meitlpjers 
do ^eek some^ advice /primarily from departmental col- 
leagues ^ind current students.' {From ^he w^y th^ question 
was^sked* it' is. not possible to know what the proportional 
concerns o!^ faculty are b.etween instr.uctional design and 
subject-matter content in the' advice they seek. It may 
be possible to infer that 'they are more concerned with 
consent than process since the primary advisors they 
choose (departmental colleagues) are likely to be most 
helpful in the content area, while those who are more 
likely to he^p with the instructional process (educational 
specialists and deans for edmcation) are turned to j»nfre- 
qUently. The relative frequencies of contact wi^ 
colleagues versus others may also be a function of ease . 
-of access. 

* 

B. Ec^cational Issues 

People are not; free to choose among options they 
do not know'exjLSt. A' central component of faculty devel- 
opment is "consciousness raising", helping faculty members 
become aware of alternatives to accusiomea practices so 
they c^n exercise a gi^eatier degrfee of control in making 
instructional decisions. The number df available alter- 
natives has been growing. , . 

During the past two decades there has been consi- 
derable activity in the design and adoption of 
instructional alternatives in medical education.- The 
utilization "tof , and attitudes toward, these approaches ^ 
provide a rough barometer of the movement of medical 
education 'out of its traditional patterns and the extent 
of the diffusion of various jLnnovations . It can also 
serve as a guide to areas that deserve 'special attention 
in faculty development programs. 

y * Tables 12A-I present data based^on faculty indiQ^- 
tions of their Use of, familiarity with and^ Views about, 
a variety of contemporary educational issties^^d instruc- 
tional in^iovations . ^ * ^ 

The range of responses enhances our confidence in 
their validity. . The estimates that #80% of all faculty 
have used "Student evaluation of faculty," or #-^1% have 
used the "Formulation of instructional objectives" might 
appear inflated, if there were not a large number of 
facul^ acknowledging their lack of familiarity with such 
issi^e^ as "Criterion-ref erence<J evaluation" (#75%) and 
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"Formative evaluation (180%) ; Similarly, very little 
negative expression toward roost issues might be suspect, 
except that a substantial proportion of faculty (#49%)' n 
does express negi^tive view& (prir-ORe area, the "Three-year 
curriculum." This is consistent with the currently wide- 
spread devaluing of such programs*. 

A Jprief comment should be made concerning ti\e inter- 
pretation of these data. The analytic methods used in 
preparing this report do not permit 'any conclusions about 
the connections between experience with an issul and vieys 
about it. It is notv known, for example, if 'those who 
have used il^tructional objectives are more or less posi- 
tively disposed toward them than those whp have. n^. That 
is, the figures f or^< '^Inirolvement" cannotfce tied ^ those 
for "Appropria'teriess/Value. " There is, however, a strik- 
ing pattern worth noting. In every instance, the 
proportion of those who are "Uncertain" about" the value 
of an issue is larger than the proportion of those who ' 
are "Slot F^iliar" with an issue. It is suspected that-, 
people who ape unfamiliar with a topic may be with- 
holding value judgments. ^ 

The following findings are felt to be particularly 
noteworthy : ^''y ' ' 

1. Instructional Objectives . (Table 12A) It is 
a reasonable postulatje that two decades ago most U.S. 
medical faculty had not heard the term "instructional 
objectives." ^ In dramatic contrast, now #.83% know about 
the issue, #61% have actually made some use of objectives. 



TABLE 12A 



^tructional Objectives 



Total 



Involvement 



Appropriateness/ 
Value 



Total 



USED 


#61^2 


POSITIVE 


#73 


HEARD OF 


#22 


toTIVE 




NOT FAMILIAR 




UNCERTAIN 


#22 











'^^or. all percentages in Tables 12/^-121 the stan- 
dard errors ari^llor less. > 
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#73% are poisitively ^disposed toWard the idea, and only 
#5% feel negatively about its value, 33 These finding^ 
are seen as an indication of the willingness of current 
medrcal^acfulty to consider new educational ideas- 

2- ^ree-Year Curriculum , (Table 12B) Although 
a quarter^t the faculty (#26%) ha\^ had experience with 
a three-year medical curriculum and an additional half 
(#51%) are f^tmiliai: with -the idea, only #11% are posi- 
tively disposed toward it, and #49% have a neg^itive 
vi^w of its appropriateness or value*. These findings 
reflect the -fact that while 26 U.S. medical schools 
hav,e experimented with the three-year curriculum during 
^e>ast decade, only 6 schools rjdtain it as their 
exc;i^usive pattern, and 3 offer it as an alternative tg 
their regular 4--year prcjigrara. Further, t^he idea is now 
in dispute at most of these ins titutions 



J 



TABLE 12B 
Thwe-Year Curriculum 



Involvement 


Total , 
Population 


Appropriateness/ 
Value 


Total 
' Population 


USED 


#26 


. PPSIT'IVE 


#11 


HEARD OF ^ 


* #52 


NEGATIVE 


#49 


NOT FAMILIAR 


#22 . 


UNCERTAIN 


#40 
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• 3. ' Problem-Orj.ent§d Medical Record (POMR) . 
(Table l?Cl Unlike the other issues being considered 
here, tne POMR was not borrowed from another- field,- but 
was developed within medicine, and its date of origin ' 
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#40% of faculty include objectives in the-ir de- 
sign of a course segment in one of the problems' in this 
survey (Chapter VIT) . . 

34 

AAMC,' "Three -Year Curriculuiti Study." In process. 
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can be j:oughl;y identified. While the work on which it 
is based has a considerably longer history, two publl- , 
cjatiofts^S mark the approxiirtate beginning of national , 
visibility ^for the idea as within the past decade. It 
is impressive to find^that #48% ofXfaculty have now used 
this, system, an additional- #30% ha\le some "familiarity 
with it, and only #22% ar^ unfamilJar. This is an 
additional confirmation that current faculty members 
are open to learning about anc^' trying new ideas. 

/ 

' / ' / , 

TABLE UC 

Prqblem-Or-iented f^dical Record (POMR) 



Total Appropriateness/ ] Total 
In vol vement Population Val ue Population 



USED 


/ 

ft 


POSITIVE 


#50 


HEARD OF 




NEGATIVE 


#12- 


NOT fAiILIAR 


/ #22 


UNCERTAIN 


#38 * 



4. Special Curricular Features , (Table 12D) 
In contrasV^to /&ie 3-year curriculum which focuses on 
time not process, the three innovations discussed here 
all refer to alterations in the way in which the medi- ■ 
cal curriculum is organized without^ regard tp its 
length. The ^"Probl^m-based" curriculum, in which the 
spr^.ngboard for' student learning is problems *o be 
solv^ rather than didactic presentations, is being 
experimented with at a small number of schools. "Verti- 
cal integration," which involves ef forts ^ to find <Ways 
for' the basic and clinical scien<:es to be learned .in - 
direct relation to each other, rather than in vertical 



35 ' 

L.L. Weed, "MedO-cal Records That Guide and Teach," 

New England J, o^ Med. "278: 593-599, €52-657, 1968 and 

L.L. Weed, Medical Records, Medical Education, and 

Patient Care: TRe Problem-Oriented Record as a Basic j^,,.^^ 

Tool, Cleveland: Case Wes^'Stn Reserve University Press, 

1969. ' ^ 
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sequence in separate years, is being tried in parts of 
the programs at some schools. The "Competency-'based" 
curriculum is probably the -newest and least tified of the 
major curricular. modifications • It is an extension of 



the thinking 


behind the use 


of instructional 


goals : 


• 


TABLE 


i2[r 






SpeciaV-Cnrricular Features 






"Problem-Based 


Curricul um" 






Total 


Appropriateness/ 


Total 


Invol vement 


'Population 


>^ Value ■ * 


Population 


USE^ 


#14 


POSITIVE 


#28 


HEARD OF 


#42 * 


' NefeATIVE 


- #9 


NOT FAMILIAR 


#44 

4 


.UNCERTAIN ' 


#63 

i 



^Vertical Integration' 



USED 


#9 


POSITIVE 


#14 




HEARD OF 


#25 


NEGATIVE^ 


* #7 




NOT FAMILIAR 


• 

#65 


UNCERTAIN 


#80 





"Competency-based Curriculum'' 



USED 


#6/ • 


POSITIVE 


#1S! 


HEARD OF 


#29 


NEGATIVE . 




NOT FAMILIAR 

» 


#65 


UNCERTAIN 


#77 



once the intended educational outcomes have been speci- 
fied, the focus of students' effort is expe^j^d to be on 
acquiring the specified competencies, not oij^imply 
putting in a predete'irmined aunount of time (saV, 10 hours 
per week, for 8 weeks) in a particular discipline. Fac- 
ulty members. acknowledge 'a low level of experience and , 



, , 37 . 



ERLC 



a fairly low level of familiarity with these 
approaches. 3o Encouragingly, their- predominant posture 
is to withhold judgment, indicating uncertainty, and only 
small numbers express negative views. 

• 5. Simulation . (Table E) The use of simulation 
for instruction has been commonplace outside of medicine 
(e.g., in tne U.S. space program, in military and civil- 
ian training of pilots) and has befen used in a growing 
number of ways in medical education. These uses range 
from written forms, as in the "patient management prob-' 
lems" incorporated into the National Board examinations 
and the six used to collect data ip this survey; to 
sophisticated technology, such as "Sim I," developed by 
Denson and Abrahanison, and "Harvey" deVeloped by Gordon; 

TABLE 12E • 

t 

Simulation 



Total 

Involvement Population 



Appropriateness/ Total 
Value Population 

#48 

#7 

#45 



USED ' . _ #25 POSITIVE 

HEARD OF #47 ^ NEGATIVE 

NOT FAMILlV^ #28 UNCERTAIN 




^1^ is reasonable to wonder for these issues (as 
fo^the issues in item 8, below) whether the faculty 
meml^Brs are unfamiliar with the terms used, but are 
familiar with the concepts or programs that tVe terms 
represent. While that situation Is possible, it is not 
likely; the terms used here are the technical labels 
attached to these issups throughout the literature of 
medical and general education, so th^t it is improbable 
that a person would be acquainted with an issue .without 
knowing the way it is referenced by those who write ^ 
about it or do work in the area. 
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to live "programmed patients. While ^25% of faculty 
have- used simulati^ons , it is curious that as many as 
#28% are unf aitiili^ar with the idea, give^n the national 
publicity that some of the more dramatic examples of 
instructional simulation have received. Although nearly 
half the faculty (#45%) remain uncertain,, only #7% have 
negative views and #48% are positively disposed toward' 
,this development, 



6. Student Evaluation of Faculty , (Table 12F) 
It is striking that most faculty (#80%)^have had experi-" 
ence with the evaluation of faculty by students, and 
that #76% are positively disposed toward this- idea, ^ 
It is likely that two decades ago many medical faculty 
would have resisted the notion of their teaching being 
evaluated in any way, possibly asserting that 'it would 
be an infriftgement on their " "academic freedom", and a 
f^r number would have bq^n offended at the possibility . 
--^that students might be the evaluators. While there are ' 
no data to quantify the extent to which views have 
changed in the past 2 decades, it seems justifiable to 
hypothesize that a substantial positive change^has 
occurred, and thay*n;he increasing cultural focus on 
accountability has been a contributing factoi^. In any 
case, there is presently a climate -in which the design'' 
of regular' programs of instructional evaluation seems 
possible. 



TABLE 12F 



Student Evd>uation of Faculty 



Invol vement 


Total 
Population 


Appropriateness/ 
Value ' 


Total 
Popul ation 


USED vfe 




POSITIVE 


.#76 


'HEARD OF 


#18 ' 


NEGATIVE ' 


V 


NOT FAMILIAR 


#2 


UNCERTAIN 


#16 



V 



3*'h.S. Barrow, Simulated Patients , s|^^ingf ield , Ma. 
C<G. Thomas Publishers-y 1971, ; . 
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In, their design of a ccjurse segment, in a problem 



li'sed in 4:his su;:vey, #49% of facultv arrange fqr students 
to evaluate^ fjaculty (Chapter VII) • . 



3$ 



5. 



7. Course Entry Evaluation , .(Table 12G) While 
not -new in the field of education generally, it is only 
in the past decade .that 'there has been much discussion 
of determining the students' levels of competency by 
pretJfeting prior to their beginnipg an' instructional 
program in med^ca],' education. Although a third of the' 
faculty (#3^%) ha.ve experience with this-practice, we 
do not know how often they use^it.39 That a majority* 
i#52%),are ppsitively disposed toward it suggests that 
faculty development efforts could lead to its wider use, 



^ TABLE 126 ^ - 

Course Entry Evaluation 

V " 

^ " Total Appropriateness/ Total 
Involvement ^ . Population ^ Value Population 

USElD > #34 POSITIVE ' #52* 

HE^ OF . * #47 NEGATIVE #7 

NOT FAMILIAR #19 UNCERTAIN #40 



8. Approaches in Evaluation . (Table 12H) Two 
approaches to evaluation, "Formative" and "Criterion- 
referenced" evaluation, are discussed together here 
because they are companion issues and the findings are 
parallel. "Formative" evaluation refers to the process 
•of continuous monitoring of a program in order to *guide 
mid-coyjrse corrections, and is typically counterposed 
to "Summative" evaluatio'n, the process of determining 
outcomes that permits concluding or Certifying decisions 
to be made. Only "FOrmativQ" evaluation was aisked about 
as- an index of faculty familiarity with this way of 
conceptualizing evaluation. 



-^^Thiarty-thiTfee percent (#33%) of faculty choose -to* 

include' pretestin^g 'in theiir^esign of the pegment of a 

course in one of the problems uffed In this survey .(Chap- 
ter Vll) . . - ' 



> 
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* * " ♦ * 

"Criterion-referenced" eva;uation ma^ be contrasted 
to "nornj-referenced" evaluation. ^0 yhe' fjLrst compyes 
each student's performance to a set of dfefined standards 
or "criteria", while the second is base^ on students 
being compared to" each other or' to soWe other group of ' 
students. 



Both formative and criterion-referenced evaluation 
are departures f rom ' donventiona^l practice. .They are, 
however, backed by a considerable body of -resdlirch and 
experience outsiae of medicine, and some within medical 
education. Faculty experience and familiarity with 
these • concepts are low.'*-'- however, as there is mainly* 
a posture of uncertainty (#90% and #84%) and little 
negativity (#2%), these wouJ.d seem to be important/areas 
of focus for future faculty development programs./ ■ 

TABLE 12H • ' ' ^ 



Approaches to Evaluation 
"Formative" 



* • 

Involvement 


• Total 
Population 


Appropriateness/ 
Value 


Total 
Population- 


♦•USED 

r 


#5 


. POSITIVE 


^ ■ 


HEARD OF 


_J14 


NEGATiVE i " , ■ 




NOT FAMILIAR 


#80 


UNCERTAIN 


#90 • • 




"CrUerion-Referenced" / - 




USED 


#8 , • 


7 

POSITIVE 


#14 


HEARD OF 


. C #17 


. NEGATIVE " ' 


* 

. n 


NOT FAMILIAR 


#75 


"* UNCERTAIN 


#84 
4 

r 



It IS assumed that most faculty- members are n6t 
f ami liar "Vith domain-referenced evaluation/"^ an even newer ; 
notion • " 
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See footnote 36, p, 38. 
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* ^ 9v^ Pe^r Review/Quality Assurance .. . (Tdble 12X)V 
These terms are subject to piorc than on^ ihterpcetatipn. 
For mafiy clinicians they are technical te^ms, referring^ 

* to legislatively m^dat^ed programs for monitoring aspect 
of patifent' qare. At the same time, these words have ■ 
their own meanings, which ^could pertain to any situation 
riot necessarily clinical. Indeed,, these .nDtior>& have 

. .been '^scussed, in the ^literature in reference tb the 

,^ instructional- mroceas. There is no way *df knowing whi^h 

• def initioiypL^^ had in mind' when expressing 

' the views* ^SMjTch the findings in Table 121 are based. 

All % that we^i^ conclude is that thes^e concepts are* 
familiar to 47i^t-bf ^ faculty the m^tority (#5'6%) ai:e " 
^"ositivjejy disposed to the, idea, and, very few (#6%) 

feel negatively. ^ 

^ABLE 121 
Peer Review/Quality Assurance/ 



Involvemefit " 


TotaV. 
Popu Tat loll 


* Appropriateness/ " 
^ Value. 


Total 
Population 


USED '/ - 


* * f 3^ 


■ POSITIVE 


#56 ^ 


HEARD OF . 


. ' #47 


s NEGATIVE ■ . ■ 


.#6 


^MOr FAMILIAR 

1 * 


'•#21 '. 

, . ! i_ 


WCERTAIN . ^ 

> 

■ 


1 #39 • 



- (JONGLUSlbNS . ^ 

> 'Chis Chapter^has presented a variet^ of findings 

'•about who serves "as full-time faculty inju.S. medical 
^chobfe, the preparation they -have had-^r their teach- ^ 
ing j4«pojasibilities , the settings in which 'they teach, 
the instf uetional methods they use, how tbey^ seek assis- 
itance, and the^r familiarity, with, and attitudes toward, 

^' several contemporary issues in medicpij education. ^From 
all of^this it can be concluded that faculty members; in 
generfil^^h^ve had minimal preparation' foiT' their ^ork ^flas 
ins^.rudPir^^ tend to follow' fairly convention|^i|J»^ 
in tfieir. teaching^ and have had little "experieSc^ 
mpst.of the neV developments in me^iical feduc^tion. It 
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// -would be^ reasonable ta'expect these circumstances to be 
Reflected fri the way medic?ll teajchers approa<jb and solve 
instructional problems'. . This is precisely what is foilnd 
in feheii: Responses to the written simula'tions, presented 
^ ^] io the next' M^ix cjiapters* . \ . 

mk , Thfe''nencouragi;i9f 'findi.nCf presented in this Chapter, is 
^ the largely positive a.ttitude of faculty to many of the 
1^ newest*fe,f tures,^df medical ^duc^tion. An important com-^ 
. EJlimentary.]ij3ding* ie, the small ^numbers of 'faculty who 

express^ negative views about th,ese innovative issues, 
• Tliis is* consistent with indications of faculty openne^ss- 
to learn j^g^ more about^ aspects of instruction, reported 
in Chapter IX. ^ ^ / 



Please note:^ . • t 

IN THE FOLLOWING SIX CHAPTERS, THE DISCUSSIONS 
OF FINDINGS FROM THE SIMULATIONS WILL BE BEST 

» « 

UNDERSTOOD IF THE ROUTES IDENTIFIED ARE TRACED ON 




THE FLOW CHART PROVIDETT AS A FOLDOUT AT THE END OF 



IsAcik chapterV-'the narrative can* be difficult to 

FOLLOW BECAUSE OF THE BR^CHING NATURE OF THE. 
. ^SIMUI^TIONS. REsA)rJDEl^T GROUPS BECOM^ DIVIDED 
^- 1N%P SUBGROUPS THAT ARE FURTHER SUBDIVIDED AS THEY 
J'ROGRESS THROUGH THE AVAILABLE ROUTES^ 

■ • w. 

you ARE REMINDED THAT A PERCENTAGE ^ftCEDED BY 



"#" Is AN ESTIMATED PROPORTION OF ALL' FACULTY. 
PERCENTAGES WITHOUT THE ARE PROPORTIONS OF THE 

GROUP UNDER DISCUSSI^>N. WHENEVER NECESSARY .FDR 
CLARITY 'BOTH PERCENTAGES ARE* PROVIDED . . 
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III. CLINICAL SUPERVISION 



INTRODUCTION 

' w 

The supervision of individuals or small groups of 
students in the clinical^ setting represents a substantial 
portion 'of £he total instructional effort in medical 
sWqqJ.s. Fxom the responses^l^ojkthe survey, it is esti- • 
mated that #61%^^ of medical school faculty members serve 
at least occasionally as clinical supervisor-e . As will 
be seen with each of the other instftctional activities 
described in the Report, the amount of preparatioR that 
teachers , have had for^this resE)onsibility is "small; only 
#15% of facility 'have attended any -workshops or other 
training sessions on clinical supervision. Of ^ those who 
did have sucn preparation^ 87% found the experience valu- 
able. 

Fif ty-eight^percent (#58%) of faculty express an 
interest in receiving printed information that would 
nelp them iirtprove their work in this area, atid #22% are 
interested in attending a workshop on- the topic. This . 
level of int^est has enfcouraging implications for 
futupeactivities in faculty development, as will be' 
discus^d in Chapter IX. ' y 

The written sinlulation that provided the dat-a ( 
reported in the chapter was ^distributed differently from) 
the other^fiye simulations used in the survey. Rather 
than being sent to a sample representing $11 28,393 
medical school faculty members who halve undergraduate / 
teaching responsJ^Dilities , it went only to a sample dr^wn 
f^rdm the' 19^307 members of clinical departments: Sevehty 
six percent (#76%) ^of the clinical faculty »re estimated 
to consider their responses to this simulation reflective 
of the way.. th^y manage problems they actually face a^ 
teac%j:s. Further, |90% believe that medical school • 
clinical faculty^ members should be able to manage the 
tne problems presented. 



. ) 



^2f(3r a* discussion pf jMiP percentage symbols 
report., see Chapter I, p^&g^s 9 -\10^ 
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in Ihis 



KEY FEATURES OF THE SIMULATION W . * . 

The primary purposes, of this simillation are* to 
examine the 'way clinical .fajculty members: 

' A. perceive their responsibilities as cliViical 
supervisors (e.g., how available to be to the student, 
whether to directly observe the student's work)^; 

' B. view the process of clinicar^^4?lstructio^ (e.g., 
the importance of determining the student's background, 
estab^lishing a relationship, communicating exE>0ttations) ; 

C. relate and provide feedback to students in the 
clinical setting (e.g., critical, supportive, harsh). . 

1 

'The problem situation is def inejjlr*as follows ,^ in the 
simulation's opening scejie: v 



Vcxcafe 3 clinical pfprepior responsible for S\H>erviSinq fnpdicai students toward the end of 
fhaif ^(ntrodu'^t'on to G'lnical Medicine course lUst prior to begmnrng^helr first chnicai clerkship 
In th's ':ours^* 'ney ha^e bcJ fnr had generj! instruction in the conduct of history taking and physical 
examiHc^Iion ThiS morr>ing you will AOrk witti Jtm Scott who will be ;fo*ng his first cogiplote new- 
DJt«fnt AorkuD The dthpr day you heard j parsing comment from anoihpr t.icuity member that this 
s'urJent >s something of a dud Your Msks today are to evaluite hts performance to give h\m 
(eedoict uind to arrange whatever foMow-up instruction you feel is.jpprc^nate It *s 9 00 a m and 
wn.te tnp slud^^nt fe scheduled from 'S- 12 you can use as much or as little of the mornmg as you 
wish You do ^^an\ to find up to an hour to complete a projoct report that is due by noon You and 
Jim greet eacri othaHand begin to plan the mornmg s actwilies 

You would now (CHOOSE ONLY ONE) 



Tell Jim to go 'ahead and examine (he-pa- 
ttent and to come to your office when he 
IS ready tp report hts findings You^xplain 
that you tj^ilk that one hour jhduldfte alt 



the 'ime he wiii need 



4 



A2 Teli Jim to go ahead and examine the pa- 
'tieot and to Ctill you if he runs into any 
i problems You explain that you think one 
hour should be all the time he will need 

A3 Ask Jim 'f he has any questions before/»e 
begins the wcf kup 



A4 Engage Jim m a discussion of his prior 
exper ences th t*hjs course 



A5 Ask Jim »o begin ^he workup explaining 
that you //iH sit irt and observe what he ' 
does 
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- The- following^ are the key features of the situation 
tnat faces the ^ respondent . ^ ^ 

1. This is the student ' s .first Qomplete new-patient 
workup, whi_ch suggests that it may be a. difficult and^ a 
, critical experience for the student, and that the super- 
visory responsibility is different from that required for^ 
an experienced student. 

.2. -While it is not possible to know the meaning of^ 
tne ohjservation tha% the student is "something of a duc^"" 

"it can reasonably be taken as a pignal that some ex'tra^ 
supervisory attention may be desirable, ^^n particular, 
it would seem more than usually necessajH^that the 
teacher's expectations be made clear, so titers tudent can* 
know where 'to 'direct his efforts,' as a basis for a fair 

,and accufate assessment of' his -capabilities. 

♦ 3, The "something of a dud" observation may also 
suggest^, that the student may be more uncomfortable tham 
most begihning students in the clinical' situation, T^iis 
would make it even more important to determine ^his stu- ' 
dfent's sense of readiness for the morning '-s assignment, ' 
A skilful teacher uses ^such information to focu^ on the 
kind of help which the student njost needs. 

4, The need for a^i hour to complete a report is 
.introduced as- a probe to discover the respondent's com- 
mitment to the task of clinical supervision. On one - 
hand, in real life , ^other Obligations do intrude on 
scheduled teaching-- time. On the other hand, it can be 
asserted that a teacher's first obligation is* to a • 
scheduled student, much as a clinician's first obliga- 
tion is to a scheduled patient. As^wiTl b^ Seen later,' 
the additional complication* of a telephone interruption 
is also introduced to gather information on the,re^poh- 
dent's judgment of the relative priority bf the 
instructional re^sponsibility • 

5. The supervisor's tasks are to evaluate the stu- 
dent, proyide, -feedback) and arrange for appropriate 
follow-up instruction. 
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MOST COMMON, I^OfES (S,ee Figure 3 ') ^ 

A, Determining Student's Background/Establishing 
a Relationship 

Before the student begins thq workup, most faculty 
members (#58%) engage him ^n a discussion, 'either by 
asking if, he' has any' questions (#37%) (A3)^^ or by 
reviewing his prior e'Sleriences (#21%) (A4) • The remain- 
^ing #4.0% have the student begin the patient workup 
immediaftely , although 65% of them (#26%) do accompany . 
the student (A5) with the intention of- observing thfe full 
workup,. The other 35% (#14%) haye tjie student begin the 
workup immediately, oh his>own, without discussion of 
any kind. Seventy-nine percent of this group (#11%) 
invite the student to t^rtl if he has any problems (A2) , 
but 21% (#'3%) simply explain 1:hat he Is to come and 
report his findings wheri done .(Al) . 'They either* have 
no intention of being available during the studefrt's 
workup or assume the student will know to call if he 
has-^problems.. ^ •# ^ . * • * 

Ther^^re some differences in subsequent behaviors 
•between those who invite the student's questions (Sec- - 
tion £)• and those who pursue ^discussion of his prior 
experiences (C) . Of those faculty members whcr invite 
(Questions , 6 3% (^24%) have the student • begin the workup 
wi,thout a discussion of thp teacher's expectations (El + 
E3 + E4) . Of those faculty who review the student's 
prifor experiences, 48% (#10%) (C3 + C5 + 04) have the 
student go ahead with 'the workup without reviewing the 
expectations. There is a further dif f erence ^between 
those two* groups; among the teachers who invite question^- 
34% (#13%) have^ the^stucfent do thd^ workup on his own 
.(El, E3),, while only '5% (.#1%) of those who review expec- 
tations leave the stuQent on his own (C5). 



^*^The overall flow-chart of the simulation 'is *a 
f61d-out found at the end of 'the chap.ter. 

44 * . ^ 

The capital letters refer to sections of the 

simulation^ the numbers to options in the sections on 

the flow-chart. 
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Only #24% oL clinical faoult^ members share their 
expectation^ for the morning's work with the s%^dent. 
The specific expectations that the respondent is asked 
to consider are- listed in the excerpt frc5m the sinjulation 
below. Of those respondents who do communicate expecr 
tations, the proportion selecting each <ff the 10 'items 
is indicated under the column, "Would include," • 

Would Indudi , 

•R1. His method of asking questions'. ' '97%(#24%) , 

^2. His ehcitation of the "Chief Complaint'* ^ 96%(#24%) 
and "Histgpy of Present Illness." ^ 

^ R3. His conduct of the review of systems. ,91%(#23%) 

R4. yj\s approach'No the social and family 9T%(-#23%) 
history. |^ - - ^ . 

' R5. His mental status exam. " ' / 8O%{§20%) /-^ 

■ R6. His technique of palpation. 85%(#2nj" 

I 

R7; His technique of auscultation. 85%'(#21%) 

R8. Histechniqueof eliciting reflexes. ' - &l%'(#i20%) 

^ R9. His method of giving instructions- * ♦ ^ ' 32%(#205^)' 

R10. His diagnostic formulatrtj'^, '* . 95%(#21%) 



Very littlQ selectivity is exercised in choosing 
among the 10 'possible areas for the morning workpp, 
despite the fact that this student is in the earliest 
stages of learning clinical work,^^ While it is 



45 . . • ' • 

It IS possible th^t some respondents assumed thai 

tjiis* list was a duplicate of the- "outline of a complete 
workup" that the student reports having ,been given aarliei 
'in the course. These respondents may have automatically 
decided that all elements should be included. 
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reasonable to* expect a*^beginning student to undertake the 
basics of the history and the physical examination (items 
Rl - 4, 6 - 8, above), it is surprising that so many 
teachers also expect such advanced skills as giving 
instructions and- formulating a diagnosis (R9 and 10) • 
No'nethelesrs , 'the studant does at least have tl?e benefit 
of knowing in advarfW^vfhat 'is expected, even if it is / 
beyond his current capabilities. As will be seen in the' 
next section, thei;e are ihstances in which some*" faculty 
members evaluate the student in areas that he was told 
would not be expected. Also, those faculty who do not 
explain their expectations at all still evaluate the 
student on virtually the same range of competencies' as 
those who do conve^^ their expectations, 

C. Ij^elationship of , Expectations to^bservations 

The essence ot the process of supervision involves 
three' steps: observi^ng student performance , ^ for the 
gathering of evaluative^ information, as* a basis. for 
providing "the studeat helpful feedback, A-desirable ' 
prior step is conveyin g ejgg isc tat ions to the student, so 
s/he can focus on those i^ues that iire regarded as 
impor'tant at this timd by this teacher. It is reasonable 
to expect cl\nic5l "Supervisors to excercjise discretion in 
their expectations and observat^otis , according to the 
goals of the program' and the level of readiness .of the 
student. In^the supervis9ry^ problem of this, simulation, 
most faculty members observe most components of the 
patient workup, exercising (discretion only uode^ a few 
circumstances^[T|bles 13 and 14) • Some facult-y members 
-who send the ^Bldent off to begin the workup o^l his own 
and 'join him fo^ only the last 20 minutes, apparently 
recognize that they would have milted the early moments 
of history taking (R2, R3, R4). Even so, there are 45% 
of each of the two sub-groups of faculty- (#14%)*' (those 
that did and those that.?iid not explain their expecta- 
tions) who do evaluate the felicitatibn ot the "chief 
complaint" and "history of presentlillness" (R2) — which 
invariably occur in th^ first few nvinutes of a patient 
workup, which they had missed. 
• * • 

In addition, it^.is interesting to note that ^6% of 
those who convey their expectations (Table 13) , indicate 
an interest in item R2 (elicitation of "Chief Complaint • 
and History of Present .Illness" ) ; yet, 100% (#14%) of 
those within this group wftb miss the first ten minutes 
of the workup (in response to th.e telephone interruption^ 
- Section M) still evaluate the student on this skill. 
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TABLE 13 

EXPECTATIONS AND OBSERVATIONS (#24%> 



f Components 
of the 

Workup: Rl^S r2 r3. R4 


— « 
Its R6 


R7 


R8 R9 


.RIO 


Conveyed Expectations: 


97^"^ 96 91 91 


80 85 


85 


81 89 


85 


, Observe: Last 20 mins. 

' im) 


97 45" 48 59 


62 83 


83 


83. 83 


■ 76 


: Miss 1st 10 . 
mins. .(#14%) 


;100 100 91 100 


91* loojon 


91 SOO 


64 


" :• full workup 

03%) 


100 90 96> 93 


'91 91 


.91 


91 88 


91 

\ 


TABLE 14 . . 
OBSERVATIONS WITHOUt HAVING CONVEYED EXPECTATIONS (#71%) 


Components 
of the 

. . Workup: RV^ R2 R3 R4 


R5 R6 


R7 


R8 R9 


RIO 


Observe la^t 20 mins-.' 
. . (#25%) 


lOO'*'^ 45 3G 3o'*6i^88 


82 


.82 88 


79 


Miss 1st 10 rains. 

(#30%) 


inn 100 100 95 


i91 95 


95 


95- 95 ^ 


-91 


Full workup (#16%) , 


100 92 92 d2 


95 97 

I ■ - , ■ 


92 


92 90 


85 










■ •-» — 
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• See page . 62 for the list of workup coinppnents. 

^^Each number^ in this Table is a percentaga of the 
subgroup of faculty that pursued the particular'^ option 
listed/ (such as Rl) under* the conditions specif ir^ (such 
-as observing the full wotkup, after having conveyed 
, expectations, in Table €3, or without having conveyed 
expectations, in Table 14), 



even though it was undoubtedly applied while the instruc- 
tor was out of the rooirit 

There are a, few remaining general observations on %. 
the way faculty members respond to the issues of commu- 
ni9ating expectations to a student and observing the 
'student's work. While only #24% of faculty members com- 
municate their expectations to the student, fully 95% of 
faculty members do undertake to observe at lea§l>-part of 
the workup. It seems clear that most clinical faculty 
members are persuaded that they should directly jwitness 
the student in action, at least during the early stage of 
^linical instruction. ^ 

* D. Commitment to Full Observation 

It can tje seen in Figure 3, Section F that #64% of 
faculty set out to observe the full workup by the student 
As a small challenge to the teacher ' s "level of commitment 
to this, a complication is introduced; just after the 
introduction to the patient, the instructor is| paged and 
finds, that s/he must step out for five or ten minutes for 
an emergency call. At this point in the simulation, the 
respondent is given a choice between asking the student 
to wait or to begin the workup (saying tiiat ,s/he will be 
back as soon as ^possible) . Thirty percent of those faced 
with this choice (#1^) elect to have the workup delayed 
so that no part will. go unobserved. The other 70% (#45%) 
choose to mi*6s the first ten jninutes of the workup. 

E. Managing the Introduction 

Those- i:espondents who intend to witness the full 
workup accompany the student to the examining room where 
they are facfed with a choice, between introducing them- 
selves and the studer^^o the patient or inviting the 
student to- proceed, vl^hing to see how the student 
imtroduces himself and the instructor to the patient. 
By waiting, the .teacher gains an additional opportunity 
to provide help Jul feedback. The point of requiring the 
decision on the introduction is to determine if the 
respondent recognizes this instructional^potential in the 
student-patient encounter. Of the #64% of faculty faced 
with this choice, 59%*- (#38%) manage the introduction^ 
themselves. While selecting this option seems to reflect 
a lack of awareness of the instructional potential of the 
situation, it could reflect a concern for the patient's 
welfare. The instructor .may feel that the' initial 
introduction requires a sensitivity that they alone can 



♦.provide • 



F eedback to the . Student 

^ ' 'J' ' — 



The concluding ste|^Uji' thl^ si^ problem / \ 

is the "wrap up" fe^4i>adk* that ' the instructor provides ( 
to the student. (Section n/ bel^fiw. ) The #3% fC^ ''faculty 
who never observe the* stiident dirdctly during the patient 
encounter all select f eeciback. which does nCt criticize 
any aspect of the students s w6rk, is generally suppolrt- 
ive, and provides for no iollbw-up. Almost aM the 
jremaining faculty are someVhat critical of the student's 
performance, 'but in a way tiiiat is supportive, .not hatsh. 
Eighty-nine percent of this\ group (#86%) provide feed- 
back which includes a const:^uc,tive effort, to provide 
follow-up instruction* , Only\ 9% *(#9%) are ci;iti(5al of 
the student's performance ijP\a harsh or dntimidating 
way* Their arrangements fcjH^follqw-up are perf undtory^^iii* 



At the completion of the workup you ask Jim to summarise his findings an^ viev« He indicates he s 
'glad it s over and that she was a difficutt'patient He\then gives a fairly systematic if mechan- 
ical review of his findings On the basis of the information you now have yo\j leil him (CHOOSE 
ONLY ONE). I - ' 

:\ • 

N1 That he performing at a reasonable * * 
leve< given his stage of training and that 
With more experience he should continue \ 
to progress satisfactorily No immediate \ 
follow-up seems necessary \ 

N2 That\ou were impressed with his thor- * m 
oughness He did a nice physical exam. \ 
IS clearly t'^ying hard, and if he is a little \ 
more understanding with patients, he \ 
should becpme a good Clinician No im-' "v - \ ' 

mediate foliow-up seems necessary " ^ \ * * 

N3 That you rad heard he wasn't do<ng wefl * ' 1 

up the Clinical area and you have tittle , i ' 

basis for changing that view. He is me- 
chanical and rather insensitive and had 
better make an effon to improve m the * 
future You advise him to seek hetp 

N4 That you were satisfied with how he man- 
age parts of the physical and parts |0f 
the history But before he can get' to be a 
good climCian there are softte issues that 
need attention You provide some specific 
suggestions and conclude by scheduling 
an appointment for another meeting > , 

»" 

N5 That if you are to be helpful, you've gor 
to come nght to the pojnt and say that he 
realty treated that patient quite badly He 
was insensitive and harsh at times, and » 
must be quite insecure to be argumg with 
a patient the way h^id 'Vou ask-how yot* — s 
can hei'p with ttwse problems 
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Nearly all faculty (#85%) select the feedback state- 
ment which is most closely related to the student's 
actual performance, appropriately supportive/ and linked 
to follow-up. This is the preferred , choice. Howevet, 
man^ fatuity members arrive there with limited pripiary 
data .about the student's actual capabilities (#32% wit- 
nessed' only, the- last minutes). In additioi|^ #75% do ^ 
'not convey their expectations tC the. student* Whilfe N4 
is the preferred fecGback choice, it can be (and' was), 
selected for incomplete or even incorrect reasons. »If 
we impose tTie stipiilation that feedback/ to be' meaning- 
ful r should bie based on previously* conveyed expectations 
, and on observation pf most ^of the student's pej;£ormarice , 
we find that only #16% of f acultynindertake the appropri- 
ate sequence of steps that culminates in- the provision 
of the preferred feedback' to the student. 



OPTIMAL ROUTE (See Figure 2) - \ . 

The recommended routes through this simulation are 
shown with darkened lines in Figure 2. The rationales 
for the choices have been discussed in the review of the 
most commonly ' selected routes, but are repeated her^ 
briefly as a summary of the .issues contained in this ^ 
simulation. * , ' 

, Options A3 (encouraging student questions) or A4 
(exploring the student's prior experiences) are preferred 
over the others in Section A; they^ provide an opportunity 
for the teacher and student to begin to know each other., 
establishing a basi^ for their subsequent cojfnmijnications . 
Those who select A4» have the pos^sibility (C2) of discov-- 
ering whether he had previously ran into any. problems 
with patiepts. This is a reasonable inc^uiry to make ^ to 
any student, but especially this one, considering the 
faculty comment that this stlident is. "something of a 
dud." * ' ^ ^ _ . ' . . 

VlheihBt the route folipwed is through A3 or A4, the 
optimal next steps, either direfctly via ^2 or C4, or ^ 
ipdirectly through C2 to 05, include an explanation by 
.the teacher of his/her expectations for the student/ s 
work. This ^_j^ounts to, sharing the objectives of the 
morning's instruction with the student.' Without them 
the student is at a disadvantage^ He can only guess -at 
whether some aspects of a total worklup can 'be di^regar*ded , 
leaving him free ta concentrate On fundamentals, or 
whether this teacher's expectcitions ^are CoAcordent with 
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FIGURE 2; "PARTIAL OPTIMAL*" ROUTE FOR CLINICAL SUPERVISION SIMULATION 



*The choices in Sections F and M are not infcluded In the statistics calculated for the "Partial Optimal" 
Route, as explained further in the text. 
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those of fbrmer teaohers. Twenty- three percent . 7|2 3%) 
Qf faculty members select one of« tY\e o^^timal rouSbqgs 
that leads to th-e conveying 9^ thedir expectations • • 

^ ; 'After explainii^g their .expectations, instructors 
^ shquld choose to observe the en%ire w,o:^up (R 13) to bej 
able to gather first-hand information on all aspects oi 
the ^tud^jit ' s perfcjprmaince. Dir6ct\observatlon is impoi 
tant becaus e^ studeat may not ^e av^are q^* his/her own 
dif f icultife^Hkd, consequently, will' be unable- to repoi;t" X 
to thfe instructor that .the problem exists, ?or example, 
a student whose belligefance has antagonized/'S patient f' 
may repofrt the pa,tient as antagonistic , "but *i% unlikely ^ 
to recognise his/her own- contribution to/the/situatiion. 
Apparently, i^jpst faculty menlbers agr^e with this princi- 
ple; through various routes (R 13^ E4, t:3, A5) #64% of 
cli'oical .faculty undertake to. sit in on the enti;re* work- 
up (Figure'; 3) although only #25% get* there by one of $he' % , 
recommended rojates/ ' . % ^ * ' - ^ 

Bef6re,%lii5^ artudent begins i||»tervie,wing the patient, \ ^ 



^|»ter^ 

two probij^eraiif'are Introduced, fCrst, *the resjiondent is 
asked ta^decide if *s/he ^^11 handle - tfie introductions or ^ 
4 wait and see wh^t (and ho^) the^ student Moes; The recom-^ ^ 
• mended approach ^is' that the teacher* wait*, as'imis provides 
a valuable instructionAl/supervi^ry oppoirtunity • Whatever 
the student cioek, ^or jdoeS not"db,^ can later be used for ^ 
reinr^orcement- or constructive critique, ' TJ>^ secoi^^prob- " 
^ lem is q:n emergency call for the instructor;, The^relay 

* isj^xpecifed to la^t l^s than' 10 minutes/. I%"^1s re com-/ '\ 

'Amended- that the start nof the , workup 'iJe Splayed * so that * 
Jie instructor *will not ,mj^s ^the opening parts of the 
ytudent-patient exchange ,Vhich' arel of ten^ crucial in 

ftefminin^ thfe quality of much thdt foj^bws* Of the ^ ^ 
#23% of faculty \lho take a .recommended route to Sectiwi, B, 
69% (416%)' -und^rta^ke to, do a fuPl observation. HoweverV 
only ^25% . (#^) have the- student manage the: introductions 
4F2)/'and oifLy 12%' <#3%) d^elay the worktip vtiilPe*they ' 
respond to tjie^emergenqy call (Ml) .y-^ / • 
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:.So few faculty selected th^. .combination of poth these 
t)tef erred' choices (^ess than #1%) that the findings on 

'the oi:her chores in this route wofild^ npt-have been 
meaningful • ' . 



;" 



58 



6S, 




The ftM^l st^p in jlhe 6ptimal rouJ:e is the provision 
of feedback^lD the st^ent. While nearly everyone (#86%) 
selects ^Bife^ecommended choice, N4 ^Fjugure.'^S) ^ only #16% 
(69%^«. those who pursue tne "partial pptim^l" route in 
Figure 2) arrive at that option pn thdff^jg^gi^s^ of "the 
appropriate backgrounji steps. 

conclusiSns • vv; . , 

The sSipervi^ion of medical students in. the* clinical 
setting* involves a substantial proportion of faculty ex- 
tort; indeed, it may be the most expensive component of 
the teaiching program in medical schools. It iS the 
dominant instructional method fon^at least half of most 
programs' and is conducted on a '?-to-l or \^ery small group 
*basis. ' The findings of this survey suggest that there is 
ccnsj.derable room for impfov.ement in the way clinical 
supervision i\; done. , * ^ 



A.. The Primali^ Areas of Concern 

^L. A faH number of clinical teachers (#40,%) ♦ 
^ 'ifot have a discussion v/ith a new student before the 
patient workup begins. 

'2. Mc^^re* than three quarters of 'clinical^ 
teachers <#76%) do no tf convey their expectations 'fqr 
t*he instructional experience to the student. 

J. • -Tew teachers seem 'to exercise discrinuha'-u^ 

tion insetting ^expectations . ^^^^^"^^ 

4. Frour items (2^ and (3-) above JW: , may be rea- 
sonable to infer that niost .clinical Reaching is "cjbnducted. 
spontaneously, without -much , <i if any., planning prioy to 
the' student • s involvement in clinical tasks or the 
in&tTuctor ' s review of the* student* s work. 

' ' 5. Less than nalf^ (41%) of those 'JaceS with a 

choice of who' manages/the introductions with a new patient 
permit the student to do it (#26%) . This suggests that 
many clini<5al faculty are not extra^c€ing the full instruc- 
tional pote-ntial rom . the sup§i;visory situation. * 

6. Less' than' or;e-third (31.%) of those faced with 
an interruption *asJc th^ student to delay-the start of the 



workup (#19%). It would seem that-ftany clinical faculty 
do not fully Appreciate the importance of the first few 
^ , minv.tees of a clinical encbunter ^n ^setting the stage for 
rnuct^ of V/hat follows. . ^ . " 

. B. Encouraging Findings 

1. Most clinical faculty (#.64%,) when serving ag 
a sufiervisor, seem to understand • the ^importance of direct 
observation.. of student performancei ■ - 

^ . - ' . ' •■ 

\,2. Most clinical faculty (J58%) have suffici-ent" 
interest in improving their skills ^s supervisors to want 
wtitten material on the subject. " 

3./ A reasonable number of clinical faculty (#2?%) 
have a fad>i^y high interest in improving their supervisory 
skills, as indicated by Chei^ stated readiness tp attend 
a workshop ,on the subject. 
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. TABLE 15 ^ 
.EkPECTATIONS 



TOTA-:. POKJLATION 



DESCRIPTIOrf OF OPTIONS 



1 Puestion Asking 



A, 



2^ "Chief Complaint" ^ Present llln^&s . A.^ 



Review of Gyntein'n 



4 'Social f. fami^ Hi. story 



Line&s 



0 Mi^pt'al -Status l.xam 

7 AuscuT^tion 

B - r]i( itmq Rcflcxo'^ 
') " Givm^j Instructior.-- 



N 



1-0 1^ J .irn>ost ic* Formula^ I'^^n 



B. 

* ^A. 
B. 

^ A.. 

B. 

A. 

B. 

A. 

B. 

A. 
B. 



A.^ 



' § — r 

, Include 
fJot I-nclydg 
: ' , ''^-^ 
' 'Include , 
Not. Jnclude 

• Jnciudc 
Not include 

Include 
Not I^i.cltifie 

• Include ^ 
Not Incl'ude 
•> 

-Include' 
Not InclJ^fJe 

Include 
Npt Include ' . 

Include 
Not InclucJe 

Include 
Not rTIclude 

I nc] lid*- 

Not Include 
ft • 



1^ 



SECTION R 



' 23 
1' 

^ 23 
, 1 

'22 

^ ' 2 

.'22 
\ I 

.19 

- 4 

21 

2 

' 21 
2 

20 

2a' 
3 

21 



TABLE ^6 



^ . " C0M?()N1 NTS OF WORKUP OBSERVED* 



TQTAL' i>OPULATiON 




SECTION^ 




^ DESCRIPTION OF OPTIONS . - ' 










G 


P 


s 


1 Questidn' Asking 


31 ' 


19 ' . 


45' 










? "Chief pDmplaint" & Present ^l^riess 


14 


19 


40 


3* ;ReviL;w of "•Systems . , . ^ 


■ .11 _ 


' \9 ' ^ 


41 










4- Social Family History • 




'19 * 


41 f 


^5 Mental Status Exam 


20 


18 




6 Palpation* . - ^ 


27 


19 


42 


7^<,^/Au.srul;tation - ♦ . , r' 




19' 


"41 


8 r*lifitin(j Reflexes ^ 


' ■ 26 


. 18 


40 


0 <^ivint/ f nstru'ctio'ns. - ^ . 


21 


18' 


40 










yo .Diagnoet^ic Formulat^.CT» ' v "'^v'****.^ 
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^'TABLE 17 

Standard Errors for the "Clinical Supervision'' Simulation 



OPTION STANDARD ERROR 



AT 


1 


A2 




A3 


^ 3 


44 


3, V 


A5* 


2 


B1 


I 1 


B2 


.-^ • 1 


B3 


2 


CI 


a 


C2 


2 . 


C3 


« 1 


C4 . 


2 


C5 


1 ' 


Dl 


2 


02 


1 


D3 


1 


El 


2 


E2 


2 


E3 


1 


E4 


2 


Fl 


3 


F2 


3 


ai 


3 


G2 


2 


G3 


. 2 


G4 


2 


G5 


2 


G6 
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IV • tlESEARCH SUPERVISION 



IN/RODUCTION ^ 

-4 The supervision pf individuals or tsmall* groups of 
s\udentrff an a laboratory setting or in a research project * * ' 
isj an- 'educational task engaged in, at least occasionally, 
#S6%49 of jnedical school faculty. In addition, #65t 
el that they a^e apt to tind themse)|^ in a situation 
ike the one described in the simulation. Only #9% of 
he faculty, however, have attended M workshop or training 
ssion on the subject.* Of thati group 83% consider those N 
eriences to have been valuable for' their teaching. 

The survey findings also indicate that #58% ot all 
cylty would like to 'receive printe*^ information to 
assist them in improving their supervision of student^ ' , 

and that #22% would attend a workshop addressinn this 
topic. ' ^ " . ' ' ^ 

The above findings demonstrate that many faculty y 
have little formal preparation for the {)artic\^ar teaching ^ \ 

responsibilities they have been asked to assum^. It also 
^ seen^s clear that many of them are open ^ receiving assis- 
tance in'^iiyproving their effectiveness in this area. The 
. following analysis of this simulation will suggest areas 
in the supervision of ^.ndividjaal students where such. • . , 
cissistance to faculty Vould be helpful; Y 

KEY FEAfUJiES- OF THE SIMULATION 

Tlje primary purposes of this simulation a.r^ to exam- 
* ine how ihedicajL faculty members: ' % * S 

^ *A. . perceive tfie process of instruction- (e.g., t^e' 
importance of communicating expectations, the value^of ' 
<3etermitiing a student ''^s baqiiground, ' the need to establish 
d rejcitionship) , ' ' . ' 

€ 

B. vifew their responsibilities as ^a supervisor- (e.g. , \ 
how available to* be, Vbether to mpnitor a student's pro- ^ 
gress) , ^ , ^ 



*^Berf^a discussion the percentage symbols iri tjiis 
report/ s6e Chapter 1, pages 9 -,10.' . 



67 



# 



C. relate to a student (especially one* experiencing 
difficulty) as a .supervisor in an independent study situ- 
ation (e supportive , detached>^ <t 



4 

The situation is defined by the ^openin^ scene: 

You/ medtcai school has i^siduted a series ol feauifed Reseaf(^ Preceptorships to provide 
medical «tudenis with a siJpervised oa^rtunity to Decon^ (amihar -wMh scientific research Each 
student IS assigf^ed t6 a faculty membe^ho will supt.' »i$o his or her work 

Jim 15 one of tt^ree students vou'wHi supervise th<5 term He was assignoa to you because you 
are currently conducting rescarcn on the problem he selected While you do noi kno«v Jim you are 
told by one of your colleagues that he is something 0' a dud > 

Jtm has recently completed a brief course entitled introduction to ReSf^a^h and the SG^er'tific 
Method and t^as been told that good research oegms with a revie* 0' the periy^cni literature .*.hef> 
Jim comes to ^ s frrst meeting you provide him wtth a current article to hetp him begifi nis lite'ature 
searcr- Within \ho Aee*<s he s to prepare an annotated oibUography for your rex e»v Ycur task's are 
to evaiuate,Jim s bibliography to give h»m feedbacK^and to arr;^nge whatever follow-up inslr jCtion 
is appropriate t3*fore he begins hts, actual research ^o'* Aith you • 



\ 



You would now (CHOOSE ONLY ONE) 

A1 Encou^e Jim to beqm and to contact 
^ . ^ou has any prot'ems Otherwise 

you Will see him m t*to AeeKs " 

A2 "Encourage Jim to oegm and arrange to 
meef ^if^ im after one ^eek to review 
hiS prog-ess 

^^3 Discuss with J.m you' expectations for 
his worx Qri this asstg^rnedt 

* A4 Ask Ji[n to discuss h,s background in in- * , . 

terp'et'ng and conduC r-g researcn ^ • » 

AS Ask Jtm if he*has' ^'Y Questions before ' , , < ^ 

beginning \r ' . * 

The following ^re the key featurles- of the situation 
that"" faces the respondent: 

. . .| 

1. The faculty meWper does not know the student and 
has Qnly minimum inforpJation regaj^ding' his background. 

2^/^hls ist a required course *in' which students are 
assigned ^ faculty. ^ ^ 

3. There is ^a need to supervise the student and to 
evaluate his work ind his readiness for the. research 
phase ofr-the course ' ^ • ■ . 

MOST COMMON ROUTES (See Figure 5) ' ' 

. ^ ' i • , 

. This section will' discuss how facility mfembers m2mage 
tbis instructional prol^lem, by* identifying tlte most frer 
queJnt- sequence of decisions associated with the three ^ 
major pptions presented in the opening scene. There is a 



fourth OE)J;ion (AS) which is/ to ask Jim if he has any ques- 
tions before beginning. While #21% choose this option/ 
85%*, of these respondents iAlBi) then proceed to sections 
that parallel A2 , A3, or A4. Since this represents only 
a slight diversion fropi selecting A2 , A3, or A4 directly, 
this #1&% is included in/ the three routes described below, 
The three main options ^re : 

A2. Encou/age Jim to begm and arrange to. 
meetyWit-h hinrf after one w^k to review 

his progress. 

/ 

» / 

A3. Discuss with Jim your expectations for- 
h/s work on this assignment. 

^ A4. Ask Jim to discuss his background m in- 

terpreting and conducting researxh. 



A. Determining the^Student ' s Background/Establishing 
a Relationship 

The determination of a student ' s readiness for 
learning a new skill or course content is a necessary 
prerequisite for quality instruction. Often, however, a 
student's background and readiness for^a particular 
instructional • activity are assumed; the faculty member 
makes an intuitive judgment about the skill or knowledge 
level .of the class arid proceeds from that point. TJiis 
approach is undesirable because student backgrounds are 
often highly, variable: some students, like the- one de- 
scribed in this simulation, are minimally prepared to 
begin instruction, while others may have already mastered. 
;nost or all*of what is expected. In this problem, the 
respondent has no prior knowledge of the student's ability 
to , operate irf an independent learning' context , and a dis^ 
cussion of background and readiness is needed. 

In this sinyalation, only #44^ of th4 faculty discuss 
th^ student's background w.ith him at any point and even 
fewer (#28%) secure this information in time ^ to make 
appropriate plans. There are six.»separate opportunities 
to engage the student in such a discussion, thre^ of which 
are before th^ student begins having difficulties. 
.^Thirty-seven percent of those who do discuss tl^e ;^udent ' s 
^background (#16%) make ^lis decision -right from the^^" 

after disfeussing expectations for 
(#3%) following a general 



opening acene , 20%.(#9j 
,the assignment, .and 
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discussion of the student's questions • In all, 63% (#28%) 
of the faculty gain an early insight into the student's 
background and^ are thereby in a position to anticipate 
and respond to particular problems. In contrast, however, 
37% (#16%1i (discuss the student ' Sf background only after 
the student is already experiencing difficulties, and 
#56% never begin such a discussion. That is, #72% of the 
total faculty do* not attend to this basic instructional 
consideration prior to having the student begin his 
assignment, 

^' Thoee'who decide to discuss the student's backgroiin 
are also asked ^to indicate what aspects of the student' 
prior experiences are relev.ant to this assignment, 
findings ar^ summarized in Table 18. While 87% (#38^ 
and 84% ''*(#37%) ' are interested in his reasons for fe^ecting 
the research topic or his expectations for the course, 
only 50% (#22%) inquire into his ability to interpret 
technical inf ormation--the basic skill required for 

TABLE 18 
Student *s Background 

Background Information ' Percent Selecting ^ach Option 

His opinfon of research in general. ' 64% (#28) 



Hi^rior experience reading scientific 

articles and reports.- 74% (#33) 







Hfs ability to interpret technical information. 


S0% (#22) 


^ *• ' . 
His reasons for se1ecti,ng this particular 




research topic. 

i • * 


87% (#38) 
* 


Hfs expectations for this course. 


84% (#37) 


— — ^ — ^ 





preparing an annotated' bibliography on the research topic. 
Thus, #78% of the faculty ask the student to proceed with- 
out anjricnowledge of his ability to conduct the required' 
literature gearc'h.* 

B. Expectations for Student! Performance ^ 

It is likely that- a full-time faculty member-' s views 
about, and corjnitment to basic^ research is different from 
that of an undergraduate medical student, especially in a 
required course. It is important, therefore, for instruc- 
tor and student to discuss their views >o£ the nature and 
purpose of this resqarch assignment before J^eginning so 
that both are clear about what is expected. The - time 
spent clarifying expectations and resolving differences 
will help avoid subsequent misunderstandings and enhance 
the quality of the teaching-learning process. 

Recognition of the need to discuss expectations is 
ce^ntral in the process of providing supervision and feed- 
back. The independent study approach is not intended to 
be an unstructured experience for either the student or 
tlie faculty member. If a faculty member is t;o-be helpful,, 
there must be an explicit understanding of the learning 
objectives and a plan for assessing student progress 
during and at the end of the course. Unless the faculty 
member is prepared to be both available, and involved with 
a student on this basis, it is likely "that the amount of 
constructive feedback provided will be insufficient. 

In contrast to only #44% of the faculty who discuss 
the student's background and readiness for instruction, 
#81% 'discuss their expectations for the assignment, 
although nbt all do so before the student runs into diffi- 
culty. Forty-two percent (#34%) review expectations 
immediately in the opening scene. Another 17%^ (#14%), dis- 
cuss the stud'ent's background first, and 7% '(#6%) voice'' 
theix expectations after first addressing any questions 
the student might have. Thus, 66%^ (#53%) of th^ ^faculty 
who discuss expectations for th§ assignment do so prior - 
to the student beginning his work. . Thirty-four percent 
(#28%), however, warit until they learr>* that the studeht 
is having difficulties. If this #28% "^is combi-ne'd with the 
the #19% who never present 'thej.r expectations, we find 
that almost half the faculty (#47%) do npt address this ' 
issue in a^ helpful manner. 

Once the respondent decides to discuss his/her 
expectations for the course, s/he is asked to decid? what. 
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specif ically^ wilT be expected of the student. Table 19 
provides a suimnafy pf the percent of faculty selecting 
each of the eight options/ While ^3% <#75%) indicate. ' / . 
they would discuss the* relevancy of this assigijment to , - ' 
the research phase of the.cdCirse^ only j65% (#53%) are pre'- 
pared to discuss how the student'^s work will be Evaluated.. ' . ^ 
Thusv #47% of the faculty, with the stated tasks of ' • . ^" ' 
evaluating the student's bibliography and providing feed- 
back^ pro.ceed without establishing a basis for that 
evaluation with t^g student. ^ • . 

TABLE 19 .* , ^ ■ . ' 

Expectflfticms for the Annotated Bibliography ^ 
Expectations ^ ' Percent Selecting Each Option ♦ 

1. The types of sources Jim should use, 90% (#73X* * ^ 

2. The format Jim should use in the . 
annotations. - - 56% C#45) 

3. The relevance of the literature " , . 
search to his work on this project^ * 93% (#75)- 

4. The importance of identify,ing key _ 
controversial^ issu6s. ' , " ^78% (#63) 

5y The depth of research you expect to ' ^ 

see reflected in the annotations.. . 61% (#49) 



6. The standards you will use to evaluate • ' 
his work. ' ' 65% (#53) 

7. The number of citations he should' - ' ^-n. 
include. . 20% (#16). Y 

8. The relevance of this'assignment to. ^ ♦ ^ 
his future as a physician. 54% (|^) 

C . Monitoring the .Student's Progress 

.Another decision- that respondents are asked to'make^ 
relates to whether they think it would be valuable to 
have- aliprogress megeting witih ther student after one week. - 
This issue is included to^ determine* faculty view their 
supervisory role in an independent study context. The 

>■' ... ■ 
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reaults indicate^ that while #91%,- decide to meet with ttje ^ 
student to -review his progress, there are major differ- 
ences within the'group. ,Sixty-^ix percent. (#60% )^believe 
thre assignment 'should be .discus^sed before the student 
begins his work. The refliainir;ig' 34% (#31%) have'their 
discussion with the student only after the ' student 'has 
begun 'his project. Thi*. -latter grpup reflecrts a rather 
limited. view o& their responsibilities in the instruc- 
tional process; while they are prep-ared to ^monitor the 
student''s progress /and to evaluate his work, they do not 
consider it necessary or appropriate to determine the 
student's readiness for' the assignment of" to share their 
*expect)ations for the work they will evaluate. , 

The second difference among the #91% who arrange a 
progress meeting relates to the comprehensiveness of their 
discussions with the student, Whilfe.,6^6% (#60%). meet with ^ 
tlie studgnt prior to hie beginning 'the' 'assignment, only 
52> of that grout^ (#47?) c^iscuss their expectations for 
the course. 'Ten per^cent (#9% ). simply ask Jim if he has 
'any "questions before beginning and 4% (#4%) inquire only 
abdut his background. However, almost half (#47%) dis- 
cuss^ their expectations wi,th the student' prior to meeting*, 
•with him to review his progress.' These faculty have a 
valid bc^^is ' for. reviewing Jira/s progress and evaluating' ' 
the bibltography he prepares. ^ ' V 
J ^ • 

OPTIMAL ROUTE (See- Figure 4) ' ^ ' 

— •> ' 

♦ . The' recor^imendtd routes "through " this simulation are 
shown by darkened lines in^Figure 4. They are' considered 
optimal because , they meet 'thr'e^ b^sic cr^.tej:ia of ef-fec- 
tive instruction. .First, fliey recpgnize' the existeno^^of 
individual differences among students and the importance 
of det'erinihing a student's readiness for the educational 
experience. Second/ they^ Sttejid to thfe need to begin th<^ 
instructional process withrthe ossification of expecta-^ 
tions*.. An^,' third, .they recognize' the ^faculty ' s^ ] 
responsibility for providing effective feedback 'and siaper- 
^^ifeion. Each of these aspects will be illustrated as. the ' 
'optimal routes are describee^. .\ 

Option A4' (discussing. Jim' s background in research) 
, or A5 . (asking for questfons) ' ane recommended as initial 
steps. Discussing expectations (A3) represents, an effort 
to clarify objectives, but is premature as it is not- ' 
based pn information about Jim's background and readiness 
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to. begin the assignment.. Once the faculty member has 
become^famiiiar witn thfe Student's experi^;nces in the ^ . 
"introdWctory cpursre and his attitude 'toward research, by 
-asking or 'invitojig questions, s/he has some basic data 
that will facilit^t^ a discussion of* expectation^. As ^in 
the preceding ySimul^tion, this is particularly important ' ' 
when a studeryt nas been described as "something" of , a^ dilra. 
While an instructor shquld not •accept'^this appraisal as ^ . 
necessaril\/ true, s/he should, at lea'St injtially, be 
especially attentive to -the ' student background. 

Asjcing the st:uden,t to begin immediately <A1 p'r A2) 
is inapprgpriate slnfee It disregards both the possibility 
that he may have particular rie^ds and the premipe that ^ 
students and faculty should jointly establish an* under- 
ding 6f^ co*Urse obje'ctives at the start of any 
tructional experience. ' • ' • . ' 

It i*V important, at ^liis point-, that an explicit - 
statement' of expectations (D7) be included before the stu*^ 
dent 'begins^ the. assi?gnment. Brief 1^ describing the. 
research*' be i^ag donducted (D9J and reviewing th^ ftiajo;- 
k steps in, conducting* j:esearch (DlQ) orUy temporarily 
'diverts the respond^it' f rom tfie need ttf^make' 'a dedisi 
>on whether .or *not a discussion of expectations 'is 
warranted! • . ^ 

It rs reasonable to anticipatefthat , despite an ^ 
explicit 9t^em^t f>f ea^ectations , the student may 
encounter difficulties. It is imp^ortant, therefore, to • 
schedule*a meetiing with ,hifn to r-eview his prog-re^s (HlO) . 
. Simply ireminding him of the deadline* and meeting in two' 
' .weeks does not provide any ^opportunity for feedback or v 
the timely, and" constructive Resolution of any problems* % 
that might occur. ^ > , 



/ 



on 



Tlje fprijnary purposes o^ the meeting are* 



to ireMiew 
repcNiing for 

tbe ,simu- 
student 



the student's progress and to assist hiiri'in^ 
the actual' resepirch phas4 of the course. (J 
latio'n text for Section L'^ -below.) Once the- 
rfeveais >iis diffiijjalty getting time to wcyrk ott the assign- 
ment , it is^^helpful to explore in ^or^ ^detail the 
progress h^F has made (tl) and w^afc approach hq is- u^ing 
in the literature search (L3) . It is nq^ likely thati he 
•is ,ready to address the more Specific i'ksue of relating 
his reading £0 his^esearch at this time (L4).^ 



'a 
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Once the nature of the student "sjiifficulti^s are 
understood, the instructor must dectfSewn^ positive steps 
can be taken "to assist him. and what respoi^ibility s/he, » 
as sup6rvist>r should ass.ume, Th^ offer to extend the 
assi'gxwnaent period {L7) comrauniiMtes 'a desire to Ijp help- 
ful, but suggests that tfie onJy;4ssue is time. Option L8 
is the recoipmended resp6nSe because it not only communi- 
cates a desire to be of (assistance / it includes the 
possibility of '^djiressipg issues other than lack of time. 
Option L5 confronts Jim with his Ifevel'of progress, but 
implies' an unwillingness to be of any assistance in" 
resolving the problem, Opti^h fails.-to confront the 
issue at .al^\ 1^ ^ ^ 



SECTION L . 



;opiespf > 



i Jim meets with you in your office armed wi^i several book^ and photbcopies various articles 
During your discu'ssion with'jim, you #CMfesk (tHOO$E AS MANY AS ARE APPROPRIATE IN 
«ANY OpOER)- . 

11 How many book'^a|id articles he has re- 
viewed.. * ^ 



If he has ^countered any difficulties so 
fa^ in hjs review 



L3 How he goes about^identifying materials 
to review 



V 



L4 What issues and concepts he feels will * * ' ^. 
be useful as background for^is work on ^ ^ 

^ ^ this tesearch project ^ • ^ . 

^ased on what you have learned, you would now (CHOOSE ONLY ONEj^ * 

Tell Jim you feel he is making insufficient 
, profress and remind him that this assign- 
ment is'due in one week * ^ 

L6 RemitKj Jim ^ the deadline for'ttie com- 
pleted annotated btblidgraphy and con* 
firm ypur sfchedule to/neet in a week 



e TO jn^t in a week 
^ l7n^^I(Iir>t«e<m 01 



L7 Ask Jim )f he fe^l/T^fPwill Tt««<more 
time to conit>I^Je "the assignment 

L8 ^sk Jim if there is any way you-can be of 
* -assistance during the second week of 
this assignment ' * . 



I 
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The final task is providing the student with feed- 
back on;his work and ^arraijging for wh&tever follow-up ^ 
instrtiction is -^appropriate. (See Section B, below.) The 
decision to 'recommend additional references for Jim to 
review and • to offer to. provide additional assistance (B8) % 
is the^ recommended response. This decision reflects both ^ 
.a recognition that the student" is not prepared at ^ this 
point to begin the, research phase, ^and a willingness to >^ 
take specif ic '^eps in assisting him with additional pre-. 
paration. Option BIO also provides him with feedback and 
indicates a willingness to be^ of *assistarfce , but it 
does not ^!^;iclude any plan «^f or addressing his .difficulties, /— ^ 

B7 is st^rictly pejorative and <ails to offer any sugges- 
for further instructidn. . Op,tions B6 and B9 also 
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SECTION B 

Tao Aet'i^s jftpf your iHitnl mp^no )tn> rom.-*^ lo youAjf'ir * mi r . ..vpi^ j p ."r(;t,it. 
' ').;'jpr>y You Aouid no^ (CKOOSE AS MANY AS ARE, APPROPRIATtlN ANY ORDER) 



B1 Rovievs hib ;it<T{ions for curf/^n| and mn- 
82 Ask 1,n ,t hf 'Pfis propaw'd to h^-grn ih»' 



E3 Exarni"e ihp way h» maly/r^ kpy ron ' * 

trovf fVvii bsues in his jnnotjtions ^ ^ . 

B4 Ask Jim '0 summanzH Ahat he ronsiders 
to be '^^e maiof issues in the itteratu'-e 



95 Ask Jtnn if there are viny ssuf^s he ^ants 
to discuss based on h^s readings 

■j Based on the information you llbve coHected, you would now (CHOOSE ONLY ONE) 

B6 Co'^i"e'>f on the strengths md' ^eak- o' ' ' 

nesbf^s you have npte^l apd encourage 
Jim tc cjntinue his reading on the topic ^ 



B" TpH J 19 you are di'^.^ppoirtipd wtth his 
^OfK infj thjt •■10 »viii hdvp to dc'ln/ hjs 
pa * . »*,on^'rT^ouf protect unjil he has 
a i.t" ft-yrasp oVthe issues * 

- ♦ B^, H^f^|^^pme^rt some additional ^efef^^nres 
forHJi'T 1 'eview and -arrange to meet 
agatn to aisist him in preparing for his 
\ ^ ,*Q^^^ri this research project * 

B9 A^ise Jim fo continue reading ir> nreas 
Anere he feeis deficient 



^ Bio TpU Jim he has not met ^ouf ^xpccto- * 

tions nrid.v#i!l hay^ to delay ^is rirfu.il \ 
work on this a''0|ect until you have had 
. " a chance to work with him on his defi ' 

1^ ciencie* 
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fail to njbt the objective of follow-up and place the 
burden for remedial work 'fbmpl^tely on a student who has 
already indicated that he is having .difficulties. ' 

CTONCLU SIGNS ^ ' . ' 

Wf, The supervision of an individual student is. poten-' 
tially the most helpful of teacher-student instructional ^ 
-encounters. The actual success of xhis - teaclvLrrg pethod, 
however, depends to ^a considerable. Extent on^ the faculty 
memb^' s Willingness to interact wit;:h the s^dent 
difflid'tly and. the faculty member's skills* in doing so. 
Whiftfe #^5% of, the faculty' indicate tbey engage in- such 
teacher-i^tudent relationships, their approach to the 
supervisory problem presented here suggest^ that mar\y may 
not be achieving the full potential of this e^3ucational 
experience. ^ \ . 

A, The Pr^^ga/ Areas of Concern , 

1.. Over ftalf the fc^culty (#56%) do not engage^ . 
the student in a discussion ofwhi's background and readi- 
ness for instruction. Th^ therefore^miss ' th<B opportunity 
to develop a relatibnship with the stadeAt and 'to indivi- 
dualize the instructional experience. ^ ' 

* ' * • ^ * • ^ ' 

2. Faculty do^pqt. make tHeir expectations ^f or 
'tbe student expliciit.- Almost Jialf- (#47%) either neglect 
discussing their expectations ^or. do it only after the 
instruction has begun. ' , 

Faculty are equally remiss m sTatmg m 
advance how tfiey will evaluate the student's woj^kj^ Almost 
half (#47?) 3o not discuis this with xthe "student ./-^ 

Encouraging' Findings ^ ' ' - - * 

^ ' . . ^' ' • ' ^ • . • 

^ 1. Faculty do choose to monitor the student's 

progress., The majqrity (#^1%) include .this fetep ir) their' 

approach. . \ , 

2. ' PacuJ-ty express a willingness to' be helpful 
to a studerlt experiencing| difficulties.' After trey 
review his final vork^ #61% offer to provide further * 
assistance. * ^ \ 



/ 



3. .Almost oh#-fo,utth (#'22%) are^terfest^- in - 
attending " a workshop, designed to' assiat *hem itf improving 
t^eir supervisory skills. 
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-eJcPECTATIONS* for AJiLlC^NMENT 



TOTAL POPULATIipN 
DRSr'RIPTION C^F OP^^IONS 



J of ^^urces 



Koi mat 



A. Include 

B. Not Incflude 

A. ij»e^u(Je , ^ 
B'^Not Inclufie 



Relevance of litera- 
ture search- to 
rubCcirch project 



LUdc 



A. InclUcie 

B. Not Include 



' 

SLCTIONS 



4 Iinpurtfince, of.cpntfo- A. Include 
versial issues*. 

^ ^epth of research 



0 , 1 vjiuati'-ji stoniards* 
7 yMJTii't r of TiTOt^ons 

/ ■■ • '\ 

f . i « Vci/i.Tj of a .sicji4- 
r^^'-tit ^to role ^ of * 
j>V/^>cian 



.B. Not Include 

• .. - • 

A. Include^ 

B. Not Include 

A. Include 

B. Hot 'include ' 

A. Inclu,de 

BV Not Inciade 

,A/ Include 

B^^ot Jnclurde' 
4 , 



6 
1 

•3' 
^ 3 



7 
0 

5' 

1 

3 
3 

5 
1 

1 

5 



4 

2 



13 
' 1 

2 

9^ 
5' 

10 
4 

4 
9 



11^ 
2 



TOTAL 



18 
1 

10 
1 



1^ 
0 

.17 

2 

11 
.7 

12 
6 

3 
14 



37 
' 2 

23 
16" 



3b 

27 
12 

26 
13 

^0 



45 

30 



5'- 



19 

lb 



77 
3 

64 
14 

^50 

2Y 

53 
i4 

IC 
.5C 



43 
?1 
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TABLE* 21 . 
DISCUSS STUDENT^.S ' 

RJ-:SWRCFI BACKCKOUNOi^ 



.TOTAL POPULATION 


SECTJOrjS 


^TOtAL 


' DESCRfPTION OF OPTIONS 


c* 

» 


D 


s 


* U 


1 Opinion op research * ^ 


7. 


12. 


3 


7 


29 


Z Prior 'experience reading scientific - 
articles • ^ . 


1 ^ 


13. 


1 


9 


• 34 * 


3 Ability to 'interpret ;techjiical infor- 
•mation * ' > \* 

■ . 




• < 

^ 10 


2 ' 


6 


23. 


4 ReasgiT-. for selecting topic 




17 ' 


4. 


.10 • 


4G 


^) f xpectations for this course 


1 . — t ^1 


lb 


4 


10 


39 ' 



tablPkJ2 2 



PROGRESS MEETING ^ 



' ^ » SoTJKL POPULJiTION • / 


V "sections 


TOTAL 


^ * DfeSCRIPTION OF OPTIONS 


' -f G 






T 














1 Number of boolcs and' ayticles^reviewed 


2 
<• 


11 


12 


14 . 


39 


2 Diff^ulties experienced 




. 20 


24 


^8/ 


75 


3 Mf^thofe for identifying what to reviBW 


1 

4 


' 18 


18 


23* 


63- 


4.' I^*iues and concepts relevant to 












project^- 


'4 


19 


19 


' 26 


68 ' 















TABLE - 2 3 

■ 

HEVlteW STUDENT^ S BIBLIOGRAPHY 
■ 

TOTAL POPULATION 



• J^ESCPIPT 



1 Peview quaJityJbf citations' * 
^ Discuss readiness'for research pnase 



3 Examine anal 



V(^is of 



key is*^«es 



4 Rfryupst summary of ma] or I'-iSues 

^ 5 Ask for questions from Gtudrnt 
■ J 



J - 



V 



- * V 


SECTION D» ' 




. 75 . 








6fa 




69 




• 






* 4 


' ■ v.. 
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TABLE 24 



Standard Errors for "R^^earch Supervision" Simulation 



ON 



STANDARO ERROR 



OPTION STANDARD E^ROR 



; OPTION STANDARD ER 



Al 


• 

1 % 




G6 


1 


A2 


2 




G7 


0 


A3 


2 




08 


0 


A4 * 


2 




G9 


1 


A5 


2 




HIA 


2 


Bl 


2 




HIB, 


0 


B2 


2 




H2A* 


1 


^B3 


2 




H2B 


' ' 1 




1 




' \ H3A 


2 


B5 


2 




H3B 


0 


36 


2 




H4A 


L 


B7 




• 


H4B 




B8 


? 




* H5A 


1 


39 


1 - 




H5B 


T 


BIO 


2 ' 


• 


H6A 


1 


C] 


1 ^ 




H6B 


1 


^2 


1 


/ 


H7A 


1 


C3 


1 




H7B 


1 


" 


T 




H8A 


1 


C5 






m 




C6 


o' 




' H9 * 


0 - 


C7 






H10 


2 


V C8 


- } 




J ' . 


1 




1 




J2^ 


1 




1 






0 




- — 7—" 


— — ^ 


<2 


' ' , 0 


D3 
D4 


] 

2 




' L2 


2* 


D5 


. • 2 ' 


J 


L3 


2 


06 


0 




L4 


2 


D7 


? 




LS 


1 


D8 


\ 1 




L6 


1 


05 


1 




L7 


1 


DIG 


1 




L8 


2 


ElA 


] 


" 


HI 


1 


E13 


0 




M2 " 


1 


E2A 






M3 


1 


E2B' 


1 • 




M4 


1 


E3A 


] 






1 


E3B 






N2 


2 


E4A, 






N3 


2 


E4B 


0 




N4 


2, 


E5A 

. E53 


] 




N5 
N6 


^ 2 




1 




N7 


1 


EeB 


0 




N8 


1 


E7A 


0 




N9 


^ 2 


£78 


1 




0]A 


^ 2 


EeA 






, DIB 




E8B 






a2A 




Fl 






02B 


1 


F2 


1 




03A . 


2 


61 


J 1 




03B 




.G2 


1 




04A 




• G3 


• 1 




0491 

05A V_ 


/ 1 

^ • 1 


G5 


, ] 




D5B^ 


1. 



06A 
06B 
07A 
" 07B 
08A, 
08B 
09 
010 
PIA 
PIB 
P2A 
P2B . 
P3A 
P3B 
P4A ^ 
P4B 
PSA 
P5B 
P6A 
P6B 
P7A 
P7^^ 
PSA 
P8B 
P9 • 
PIO 
PH 

pi 

R2 
ST 
S2 

S3 
S4 
S5 
S6 
57 
S8 
S9 
T1 

T2 ^ 
T3 
T4 
T5 
T6 
• T7 

T8 

T9 

TIO 

1j3 
' U4 

U5 

U6 

U7 

U8 



OPENINO SCENE 



3 t) 4 




FIGURE 5 TOTAL ;tlPUL*T!ON filsULTS FOR "RESEARCH SUPERVISION" SIMULATION (Nurt>*s are' estlrrftted wi^:entages of .-^ 
the popuUtlo/i selecting thp option Indicated,) . * ... t^^'^entages ot ^ 
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V. SMALL GROUP DISCUSS 101^ 



INTRODUCTION 



The survey results indicate that #65%'54 of all fac- 
ulty use the g|iall 'group discussion method on a^^requent 
bafsis and that #61% would find themselves;' in their teach- 
ing, in a situation like the one in the simulation. Only " 
#23% indicate that they have ever attended a workshop ^ 
training session on small group teaching. Ninety-one per- 
cent 91%) of these individuals consider such , preparation 
to have been valuable and helpful in their teaching. Vit-. 
tually a third of current faculty members, (#.32%) indicate 
that they would be intft-'ested in attending a workshop 
directed at improving their small group teaciiing skills. 

' Apparently/ while fac-ulty members 'use ^the small 
group discussion method frequently, most have not -had any 
specific preparation for use of this tecnnique. The 'fol- 
lowing discussion will analyze how medical faculty manage 
a particular problem in small group teaching, in an effort^ 
to determine what preparation inight be needed.* . . * . 

KEY FEATURES -OF THE SIMULATION ' * s \ - ^ 

/ ^ ' . . . ' - V 

This simulation is designed .to determine- how faculty 
members:, - •* ' m ^ i 

• . . •- 

A. approach a problem in-^small group instruction- ' • 
(e-gt. , what informatid^,'C?|e'y 'gather a?id in what order), ^ 

■ ,B/ view th^ir' rj^me^^as instructors .in the' small 
grouiji setting (>e.gv; cbA>e;rtrt: experts, resources, grotip ^ 
facilitators), , ^^V-^^ 

" r : ■ ' ' \ 

C. regard the relationships between groyp process 
and Learning (e.q: , stagey of group development, the im- 
po^rtance of peer, interaction). ' '\ . ^ 

^ \ 

y ■ ' ■■ ■ ■ ■ • ■ 



* ^^For a' discussion of the:, percentage^ symbols in^bhis 
repbrt; see Chapter I, p^^es 9 - 10. , * . 



The opening scene defines the problem; sitaati 



iation\ 

■ ) 



The \iniU ' ■>raduatL curr culum commttfer derided - y* if ir) ,j'f'>f hi ,\ y \r frit d*( Ji "-fuUfi's 
Op' on ot en'ol'inq^n piint.'r a i->ctuf»» shciiom c mii tti j<ui,p icac f t>ci (jn in s>'ver«<l mtroduc- ' 
'UfSt N 'Ouaqr(»e(J .ii. di'Mhrce of youf" coUcM'jut j> in l-,' ic n -n tht^vfinM <roup SfMirtq Tht- 

Oi Ui-'} thiffj \-'Pi^ u' thi< roursp you nrt it 'O j> ninl bv 'hft'. of /uih U) studuntb Afjo 

r« '•■.s tnt '^n'-t>fn ow'f "^k I u k of prof)roi> . iney i 'fi' qr ''ip . n> iKtfuj ,ni(J ,i > you lo con- 

ftm ; '0 th. inuf(. 'Mdit'on.u U'Ctu/e ionn.ii I'lr-yi ..(tfi J <i *>fi fioufti i-f 'n i-i-' wifhm 

n. it \. » ^ f 'I'^p rourst > to be s ilvjqod 

You *^rou<d now (CHOOSE ONLY ONE) 



' '/ p>i _ 'L/d' lot * ■;cu .s ih.' If son 
1 ' 0'^'^ /OU' f^n-is P/nr>r e>nr'T * 



'jatcjn A 'K her 



The important. elements of t^is instructional prob- 
lem' are : * ^ ' ' 

1. These students are in their first year. Be- 
cause of this che^ are likely to experience some anxiety, 
regardless of the instructional forjtmt. Their high level 
of motivation and the competitive nature of their pre- 
medical experience cpntr.ibute to their concern about 
"measuring up" to other students and meeting the expecta- 
tions of the faculty. Small' group teaching tends to 
magnify this concern; while student? can remain anonymous 
4n^lectures (and ^therefore less^prfene to "exposure"), 
tneir participation in small groups* makes them vulnerable 
to' evaluative judgments by both faculty members and pe^rs 

^ 2. Only three of the students expressed concern. 
Regardless of the instructional setting, a faculty member 
should be careful neither to generalize to the group 
indiscriminat|ely .from individual students' feedback, nor 
to disregard minority opi^iion. In small group teaching, 
these cautions are especially important because each stu- 
dent represetits a potentially valuable resource to the 
group; if anyone is experiencing difficulties with this 
approach, 'the entire group can be affected. ' It is 
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reconun^nded, therefore, that the experiences > of .th^' three . 
dissatisfied students nqt be viewed as an isolated situ- 
ation, but that the perceptions of the oth^r seven students 
also be sought in an effort to work toward a solution to' 
the problem involving the entire group. 

3. The class is in the third y^k^ of a twelve week 
course. The perception of the three students is that the 
class is moving t6o slowly. This 16 a common reaction 
from students who are accustomed to a more structured and 
passive approach to learninq. It must be realized,^ how- 
ever, .that small group teaoning usually requires more time 
an(i greater student involvement tharj. the lectu/e method 
before students realize a sense of accomplishment. It Is 
important, therefore, that the faculty member encourage 
the students to be patient .while working through' 'th^se 
initial problems. ' ^ 

The various sections of the simulation provide the, 
respondent with information from three, dif ^ei;ent sources 
at various levels of detail. The instructor c^in speak 
initially, for instance, with ,the three students experi- 
encing difficulties to learn what these^ students consider 

^ to be problems with^ the coursQ.^ S/he"can then pursue the 
discussion 'further , in an effort to de^berfnine why the 
three students are ^experiencing such difficulties. "The' 
respondent also has an ^opportunity to meet with the other 
seven members of the class, to- obtain their reactions to 

I the course and, similarly, to continue that discussion 
for background oh -why they are not dissatisfied; 

The third available source of informatiSn-^is ^ faculty 
colleagues. , Dire(Jtly after th6 problem is. presented/ r'es- 
pendents, have the ^opportunity to discuss the sit:uatlon-' 
informally with a friend experienced in^ small group ^teagh- 
.ing. 'At several other points in the* simul.ation , faciillSy 
colleagues dutr^ntly^ teaching in small' groups are ava-il- 
^%ble for specific advice on various options for addiressing 
^*the problem. . - ^ ' * . * 

Regardless of what information st5urc^s respondents 
u«e, in whatever order, they then choose ^aitipng five options 
for solving the problem. These' are,: 

1." Recommend that the three dissatisfied students . 
:^ stick it out and offer ba assist; them with those areas 
' bhe course 'material in Which bhey feel deficienb. 
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2. - gecommend that the three dissatisfied s'tud'efits 
transfer to a lecture s^ection arxd.offei; to assist them 
with the proqess. \ ^ 

3. Reassure the three^ dissatisf ied s^tud^ents that . ' 
they are" simp*^ experiencing'^ noju ^ l anxieties for first- 
y-ear medical students and reconunenS that thej^stick it < 
out. ' • • J • ' ' ' " ^ 

4. Devote a cla^s session to^ disciJIs^Tag ^the- issues^ 
•wi'th the entire group. 55 • 

" '•^ > ' ' ' 

5. Modify the* current format to pr.ovide more 
didactic presentations as part of the ses^siaft^.55 ^ 

^he findings' for this ' simu;Lation a;re reported tv)o 
ways,f*''*First, we will look -at Wh^t- information Tadulty 
gather, without regard for/ the order in ^hich it is col- 
lected (e.-g., what percentage qf the 'faculty ask their ' 
colleagues for. advice at any point* in the simulation?) ^ 
Second;^ the order in which faculty collect informa^tidn 
is examined to^under9?band better the common Naopro^ches 
used in solving the problem (e.g, , which studerTfc^are 
approached first, and does this decision affect the way 
the problem is .resolvec*?).. • - 

MOST^ COMMON ROUTES (See' Figure 7) ^ ^ - \^ 

A. Information Collection . ' " • 



At the outset #86%' of faculty have at least an 
initial meeting, with the thr,ee dissatisfied ' students to 
hear their .concerns abcJut the coui^e. .While this'^t^ro- . 
portTOn is undoubtedly largle, it (^puld be recognized 
that remaining #14% (a a*final * 
decision without any knowledge of ithe^ particular problems 
these, studentg- are experieocing. ' " 

Further, only ^68% of the, faculty discuss, the prob- 
lertrwith the other seven s|:udents in the; class. Thl,s ^ . 
means 'that '#32% of the* facuLty^ make a £inal. Aeeision , • 
without ever J^nowing whether the* other s^ven, students 'ar^ 



-^-^These optiorls are" aval lable onl^ once during thfe . 
sinrulation. The others are repeate'|^» E>erTiii-tting *^spona- 
ents ^ to ipursue these decisions vi^ '^ny ^^ol*der the^^ choosje-^ 
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experiencing difficulties similar to those .exprressed by 
the, three that complain. Perhaps* some respondents , a'esujned 
that if s^omeohe is' experiencing dif f icqlties s/he will 
CG^np^lain' 6r stiiia-t •the th^ree students , were speaking for the 
entire class. . . ^ . . • ' > 

The hext most co'mmon source of information invol\fes' 
both the initial discussion with the three students and 
a contj.nuation of this discussiori, in pursuit of factors 
that, migat help exptain ,th'd problems. - Forty-eight percent 
{M8%0 of the faculty collect at least this much informa- 
tion, -in contrast, however, £hife alsQ implies that #52% ' 
'of the faculty malce their decisions without collecting 
data on wHy these students ate experiencing difficulties. 

- The opportunity to speak -with colleagues Who teach, 
in-s^nall groups' is kvarilable at; several' points in the 
simulation* Seventeen percent (#17%) choose to solicit 
advice from their peers, while #83% do not. This appears 
inconsistent with the view expressed in^ different part 
of the survey by #42% who indicate tha*t' they frequently 
contact Ui&ir colleagues for Assistance or advice on 
instructional- issues and problems . 56 ^ ^ 

^ ^ Respondents who* meet^ with , the other severr-students 
learn they are .^ware of their classmates problems but 
that they themselves are satisfied.- Faculty then have* 
Several opportunities to search for reasons explaining 
why this' group is ^satisfied with the course. Only #15% 
of the faculty mak'e an attempt to gain such explanation. 
Thus, while #6^% of the faculty 'discover the exteTtt of 
dissatisfaction in the class, less -than a^ourth of these 
faculty pursue^fthe source of the problem.^ In total, #85% 

.of the faculty mak^ a final decision without collecting 
information^ alpout h6w and why the seven fea'tisf ied students 
differ from tlieir classmatejs. » 

The least frequent approach to collecting informa- 
tion is to pursue, all fiye opportunities (i.e., initio 
and detailed, discussions with both groups of students plus 
advice from colleagues) for understanding the problem. 
Only #7% of . the faculty collect the maximum -amount of 
information prior to making one. of the ^4ve decisions. 



See Chapter II, p.. 32 • * This apparent discrepancy 
is conceivably explained by the possibiAty that the re- 
spdndentg to the simulation -did not regard, the situation * 
as a problem. ' r ^ 
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One possible explanation is that faculty rely heavily on 
their prior experience as teachers and their own intuition 
in managing such problems^ rThis interpretation is sup- 
ported by the binding that #62% of faculty indicate that* 
their own intuition .and judgment co'ntributes strongly to, - 
•the way they tfeach.57 * * . » 

Faculty appear ipore interested in knowing that the 
other seven students are not experiencing * difficul\J.es ^ 
than in understanding why. The*ir approach is' thus one Of ^ 
isolating the problem' to the three students and making a 
decision on- an issue considered to be rele^nt only to 
•this sub-yroup. Additional support for this analysis will 
be -pr.e'sented when specific routes are discussed below. 

f . B.. Sequerice of Information Collection ^ 

In this simulation t;here are five final recommenda- 
tions available for jconcluding^ the problem presented in 
^the* opening scene^ Since a respondent could select only 
one 6f 'these conclusions.lt As possible to trace the pat- 
ticialar sequence of inf ormatixin collection leaj^'ing to ^ ^ 
each decision. While the desi<^n of this simulation pro-^ 
vided the opportunity to>make ce'rtain decisions at mul- 
tiple points in the 'process (e.g.,, there are fourteen , 
points at which ^transfer could be recommended), only the. 
most frequent routes, representing at least #5%, will be 
discussed. Table 25 provides a sumiTlary of all routes andi 
the ajnouitt of information collected prior to Qtch of! the 
five decisions." . . • . 

*1. Offxer Special Assistance 



The most common solution is the decision to 
^"recommend that the three dissatisfied students stick it, 
put and^ offer 'to assist them with those ar^eas of cour-se 
material in which thfey feel deficient." Forty-eight per- 
cent (#4^%) of the faculty make this choice. * The most 
common routes followed in making ^this decision are: 



41% of , the faqulty that make this decision (#20%) 
do so after meeting with both groups for an initial dis- 
cussion of the problem.' ' Twenty-six ^qrcent (#12%) meet 
fifst with the seven studeiits to determine whether -thay are 
also* e:;cperiencing» difficulties and then with the -three 

. — - . ' ' ■ / '• 

^^ First Preliminary Report ^ p* 90. * 
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TABLE 25 ^ 

,5u[iinary of Amount of Information Collected 
Relative to Each Decision 1n Small Group Discussion 



# Sources' of .Information 



Becision 





Provi de 
Special 
Assistance 
(#48%) 


T ransf e r 

To 
Lecture 
(#28%) 


1', 

Normal 
Anxieties 
(#13?) 


Devote 
CI ass 

Session 
(f9%) 


. Modify 
Format 
(#2%) 


. » No additional information 


V 


9 








• Inl^rmal discussion with a friend 
" «: f 




3 


t 






Jnitial discussion with the three 
dissatisf led^tudents 




15 * 


46 


- 




Initial discussion with the other 
' ^ seven , students 


1 « — 


- 18 


' 50 


- 




• ^ > 
. ' , Initial discussion with both groups 
^ Of students 


41^ 


21 








Initial and detailed discussion with 

the three stud^nts^ ^ i 


' 31 \ 


3 ^ 








^ Jjt*Tiitial and detailed disCu&sion vJith 
the ^even students 


1 

^ % 






• 




jfr%v>.. 'fnitidl and det^rjpd discussi^ with 
^^^•'S the three students pi us* a faculty 
consult 


4 


- .3 , 


.1 






Initial and detailed discussion with 
r the seven students plus a faculty 
1 « consult * ' ^ 




* 




V 

1 


• 


Initial and detailed discussion with 
the^ three sttJdents plus an initial 
meeting ^^^^ the other seven students * 


10 


11 






♦ 


Ini|ial and detajled meeting with the 
. seven s^tudents plus an initial 
(peetingwith the three students' 




, 1 








• 

Initial and detailed discussion with.. 
, the three students plus an initial 

njeeting* w-* th ^the sever students and 
- a faculty consult 


• 7 


1 

13 


1 


39 


•41 

.i. 


^ . • * ■ , 

' ^, " ^ , \r\^\^f\ and detailed disousarfon with 
• 1 the* seven students plus, afrHpi tial 
nieeting with 1;he three^tudents and 
a^^acul ty, cotTs<j1 t . ' 


\ V 




1 


1 




* • Initial 4nd detialed discussion with 
both groups of students , 


1 






15 


..25 


^ - — . ^ < 

y rn>ti^l and detailed discussion with 
both groups of students plus a 
* faculty consult j 


5 


1 ' 




. 44 


34 
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Students t^^earn the nature of their problems, while 15% 
(#7%)' reverse this^ process . Appar'ently, theveequence s^does 
make some difference. Tho^e who speak with the seven stu- 
dents first are tnore prone to end the problem with9\4t 
exploring further why eithe^grjbup is^or is not haying 
difficulty learning in this^etting! \ 

31% (#15%)^make their decision on the bas^ ;o 
initial and follow-up talks with the 'three complaining 
students, but wittiout interactions with the other 's^ven 
stwd^nts. The'se :aculty deal with the ^'three students in 
isol^ation from thei.r classmates. ^ They^ apparently rule 
out the possibility that others might "also be having 
difficulties or might be an impc^tanl: factor in reachin<5 
a, Bolut ioji. ' • 
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y 10% (#5%) cjo ®ne step ^further and include an 
initia^l meeting with the other seven studen^t^ -along with 
an initial and detailed dik:ussion witH the 1;^hree stu- 
dents. .These faculty ar,e more thorough tKan the respond- ^ 
ents' described above, but even though they know that the 
course is currently causing prob-lems for cnly a minority 
of students, they cannot discern' why there is this dis- 
crepancy in the students* experiences. Toey seem' to 
assume that since the seven students are not dissatisfi^ 
they need not be involved in* a* decision regarding this 
4«sue.^ ^' . ^.^^ 

2. Transfer to Lectujfe ■ . ' 

m 

The s*econd most frequeht decision is to "recom-- 
-mend that the three, dissatisfied atu^ients. transfer to a 
lecture section." Twenty-eight pterc>ent (428%) of the ^ 
population indicate that this woyld be theilr choj-ce. 

. ^ 21% (#6%) make- this judgment follpwing an ini- 
tial* meeting with both groups to discuss the problem. As 
is trvie with the decision to Offer special assistance 
(described '^above) , faculty who' tneet^'f irst with the seven 
students ^nd learn that they are not , currently dissatis- 
fied (15%) (#4%y are more likely* to make a decision at 
this* point than faculty who meet first with the three who 
express dissatisf ajption (6'S.) (#2%). Orvce adain, faculty 
who begin solving the problem by ' determining 'that the 
three are a minority 'appear to have less interest in "these 
students than iio those who address the'^jf problem directly, 

/ ' 18% (#5%') >of the faculty- recommend 1 that the 

^three transfer without even talkifig with' ther^* By simply 
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talking with the other seven students and learning that 
they are^ not dissatisfied these instructors decid,e that 
the issue is unresolvable within the gro^p. This is 'an 
even more ^extrem.e isolation ©f th,e problem than previously 
described. r * ' * 

•Compared with the faculty who decide to provide 
$pfecial assistance, faculty recommending transfer collect 
less information bearing on the problem^ Sixty-six per-r 
cent' (#18%) , for example, make, their decision wittiout 'any 
infomation about why -either group is or is not henef it- 
.ing from this educational approach. While it-can-be 
argued that notr all students will benefit equally from 
the s^e approach, it is, nevertheless ,j important that 
faeui^y demonstrate, a willingness \o vjork toward achiev-' 
ing a meaningful experience for each student, '7 

3. Normal Anxieties * . ' 

The next most common decision is to "reassure 
the three dissatisfied students that th§y- are simply - 
experiencing normal anxieties for first-year medical* 
students^ a*id recommend that, they stick it out:." -Thirteen 
j^rcenr/(#13%) of the faculty' select this approach-. 

50% (#^6%) have only an initial meeting with the 
seven satisfied students prior toi' reaching' this concTu^ion 
A striking feature of this ^roup is that they make this 
intuitive judgment without ever discussi;;*^ the situation 
with thQ thrde dissatisfied students. The issue-here is 
not whether the difficulty is normal anxiety or something 
else, ^ it is rather a question ofjiow faculty Should relate 
to students who express such a concern. A reco'qnition of 
and appreciation for the dif f icfulties some students may 
initialli^ experience in the small group setting is not 
evident rn/^this response, 

V 46% . j(#6%). have only an initial discussion with 

the three dissatisfied students prior to making this decli- 
sion. , While this groUp at least speaks to the fetudents ' 
iftitially involved, they fail ^to pur^sue and verify their 
speculation that "normal anxiety" is the 'cause of the prob- 
lem and that time, alone will resolve the issue. 

n The problem- presente^d in this simulation is 
common ahd.it can be expected that some stoadents will * 
ad^^-ust more slowly and experience more anxieties than 
otherp.' The criticism of those who select" this route 
is that they rely almdst totally on intuition and make 



only a modest attempt to underc tand . the problem. • This . 
approacfh is likely to communicat'e a -lack of interest/ 
'wt^ther *^uch is -the case or -ncnt. *If, hr)wever; the stu- 
aents' jjroblems are more complex, this approach could ^ 
actually ^e .ha±7nful- ^ 

4. Devote Class Cession . ' 

*3 Tbe next most frequent approacrr *is to ' 
"devote a class session to discussing the issues with the 
entibe group. " Nin^* percent '(#9%) *f the faculty make 
this' "Se^cision. This option; and the option of "itiodifyinq 
the current ^format," is or/ly available at one point in the 
simul-atioH/ aftel: faculty have colLccted some initial 
information^ • ^ ' . 

. A ■ ■ ' ' ' 

. S inae there arc no roytes which represent the 
choices *of at Ifeast #5^. cf Jdhe faculty, individual routes 
will not be presented. ^ It should be noted, however, that . 
fifty-nine percent of the faculty v;ho muke thi-s decision 
(#5%)', are the^imost thorough in collecting information 
re-levant to thev problem^ They pursue ^le issue in detail . 
with all ten students. They are able, therefore, to learn 
not only^ why tbe three studen'ts -are dissatisfied but also 
why the other Steven students ar^ enjoying the initial 
weeks of the coui^ge. And, in ^aaking this decision, they, 
are recognizing that a solution to the problem 'expressed 
by the tr^ee students may best be arrived at by involviuq 
all ten students. ' . * ' 

) 

5: Modify Current Pornia^ 

The final option availabl^^ iti this simulation is 
to "modify the current f orn\at to provide moio didactic * v 
presentations as part of the [ sj^all group] sess-ions." 
Two percent (#2%) choose this bption*. 'This choice, like • 
the preceding one, however, is avai 1 able '-cwily \ohce r ''J ate' 
in the simulation, when #74% of the faculty have already • 
made another decision. 

Since sueh a email percent mak^ this dacision,\ 
individual routes are not pres\ent*ed. This group .is 
similar, however^ to those -whoXdevote a class session to 
the prQblem in ttjat they are ciu\te t^horough in their ^ 
diagnosis. Their d-^ision, thcu<sjh is^ cjuitc different* 
Th'ey decide not to*|^yolve all ten students- in A resolu- ^ 
tion of the problem', -^but rather ta agreu^ to the request 
ma3e^ by the .three students for more l?:^dture-type pre-* , 
sentations. While this decision -may indicate a ^sincere 
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desire to work with the students having difficulty, It - 
runs the ri^k of creating a new set of problems for the 
otn^er seven students Who are enjoying, the current format. 

The abbve review ^has described how faculty memberg 
manage this particular ^educational problem. While suqYi] 
.simulations al:d only an apprbxim'ation of* what might be' I * 
observed in the actual teaching process, #79%, of . the 
faculty indicate that their responses ^ this simiJlatipn 
do reflect how they manage problems Ihey, face as '"teacher's , 
Th^s congruence between the problem presented in the 
*simolatidn and the way. faculty report they teach makes it 
possible to suggest soine specific implications for the 
Equality of teaching in the' small group fo;:mat. 'This anal- 
ysis will compare the optimal, research-suppojrted route ^ 
with the most comraofn'outes followed hy faculty as 
described above. 

. < - c • ■ • 

THE OPTIMAL ROUTE (see Figure 6) 

» 4 

The remaihdej^ of this discussion will focus on a 
presentation of the optimal roate through/ the simulation* 
• and "provide a rationale in support of this approach. Only 
#2% follow th:^.s precise route. The percentages provided 
'in the analysis below will descr'ibe th^^roportion pf the 
total faculty that 'begin with 'the recommended option,' bub 
selecit non-recommended options at various ppints -aiong-.tlie 
way. (While #55% fcegiri, only #2% complete the optiraaH ( 

^ The decision to meet first with the three students 
who have expressed their concerns is the most direct re-' 
sponge. It. not only communicates a sincere interest ih 
their problem, but recognizes the faculty ' responsibility 
for the success of the group. ■ While #55% of 'the faculty 
make thi^ decision, #36%' of their^ colleagues meet-j first 
with the other seven students in an effort to determine' • 
the scope of the prob^t^; 

The recommendation that the students transfer is: 
not ^ constrj^tive response'/ The ^3% of the 'faculty who 
make this choicTB seem to be suggesting that the .three^ 
students are totally responsible for the existing situ- 
ation and that ther:e is np way of resolving these ' problems 
within the,^roup.' There is not enough information at* this 
point to justify that decision. 
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Tlje second step in the r^commenc/ed route is to pursue- 
the conversation with the three. stoKjents in More detail; 
While the initial • conversation gives an indication of ^ the 
prc^lems , it fails to provide any insights 'into why these 
problems fiave occurred. *By inquiring into the ^tuderits ' 
backgrounds >and their expectations for the^ course, the 
faculty member gains* some insight into -the problem. Thirty 
five perceftt (#35%)' of the faculty make- this decision, . * 
while #^% c^ocJse to talk^with the other'^seven students 
Sefore jproceeUing, The disadvantages' of not continuing 
the discussion with the thre^ students at tljis point are 
that they might view t;his as an indication that ~t:heijc> • • 
problems are onXy legitimate- if others share their colicerns 
and, also, it is leas effi<5ient to, have to schedule ahother 
meeting' at a lat^ da.te. This <:ontentiop is suppprted by 
the finding tha^t 64% of 'the #14% who*did pot continue the 
immediate conversation ended the' problem, with6ut a secdnd 
meeting. ' ' " 

*i — ~ 

^ .Now the instiructor who is following the recommended 
route has some ba^ic information about the three ^students 
and some clu6s as'to^why they may be' experiencing diffi- 
culties with shall group discussiprl. It is now appropriate 
that «/he determine whether \^e other students in the cl^ass 
share this concern since a different course of action may 
be necessary if piore'±han the three students ^re experienc- 
ing ^if f icultie*^ ^ 



y Ten gercent (#10%') of the faculty 'make this' decigicn 
to meet -with the othar s'even students 'ai: this point. Six- 
teen^percent (#16%) , however,, end the probdem, primarily 
by Agreeing to assist the three students individually with ^ 
tneir dif-f igulties • While .this cdecision cferjfcainly seems , 
to communicate a sijpcere interest in'the'thrfee individuals 
initially involved^ it .fails to recognize the possibility . 
•that other students might' also be experiencing difficulties 
and Require ^sorne as»is/tance, and that the inVO.lxjement of 
all 10^ studentd may^ be nece^ary to resolve the issues 
Idescribed. , } ' * * 

The opticm of seeking advice ^rom peers indicates a 
willingness *to be ,open about the problem, but the #8% who 
phoose this approach .do so prematurely, without 'fir^t 
defining the sqope of the prot^lem. * - ^ 

The faculty who speak, to the other *5even students 
learn that 'they are not dissatisfied with the course, ^nd 
that they are aware'.bf the difficulties their classmates 
a^re experiencing- f ' 
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It mighflf'be assumed that the problem has b'een iso- 
lated at this point and tThat .future* effo^rts should be r- 
directed at only .the three complaining* stude^nts, .This. • 
approach is not .reconwielided. While- in o-ther instructional 
settings it may be* possible ^to^ isolate and respond to , , 
individual student problems, In small grgup teaching each 
student's participation^ is_J.mport,alVt /and the only lasting 
resolution must irfvolve the entire group. Even df the 
response is .to provide individual assistance to ttje*three^ . 
students, it is unlikely that this ,will improve, the stu- 
dents'- abilities to^ function and contribute Within the 
group* * * *• * * ^ ' I 

• \ ' • • ' ■ V ' \ ' 

\ The next step in the- xecommeAded approach, therefote, 
1? either to contintie ttji^ initial conversation witff^ the 
seven stuclepts in an' effort to gather some ii^^aseline da-ta 
for comparing, and understanding potential differences'^ in 
student satisfaction: with the course* (chosen fey #3%)v,^or. 
to meet with colleagues for advice on- the probl^em (qhosen 
' by #2%). The advantages of c6ittiniy.ng the existing^ dis- 
cussion with the sevdn students are that this is more ' 
ef f icient . than scheduling another meeting ^nd that com- ^ 
parative data on all. ten, students would provide a .strongejr 
background for - assesi^n^ 'tifie advice - provided by the^' other 
faculty. * , ' 

^ovf that the faculty, member has collected i/iforlrta- 
tion from all ten ', stildents , it -is recommended that s/he \ 
approach, other fadult^ who teach in • small groups for \ 
their advice. (*If thi^ was done as a previous step, the 
choice would now be to meet^with the o^her students td 
'learn why their expedience has been more positive.) Since 
an/ decision has the potential for both positive, and nega- 
tive c6nsequences , the opportunity to reflect on >he 
r.elative $tra|;ngth and weaknesses of several approaches is 
an important step in the problem-solving process'. The 
decision to ^discuss this problem with peers al^so sugopst's 
an Openness to critio^ism and a willingness to 'learn\ ^whxc^h 

' are -'desirable characteristics in teaching^ bnf oirtuna^ely^, 
many faculty view seeking as^^stance ^s tantamount to ^ 
admitting failure' and avoid suc?h a step. The finding ^ 
(from tlii^ simulation) that only #17% of faculty, seek 
advice from their x:olleagues' at one*of the f.ive points 
where it «is an option tends to confirm that .this is not a 

f readily pursued step. 

• , The recommended decision atr this p'oint, would be for 
the instructor 'to confront the entire cl,ass with the issuea 
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. and share with them his/her impressions^ . based on the 
inf bjnnat ion gathered . • While this approach does not" 
guarantee resolution of the problem, it is suggested / 
because it- is not possible to .accommodate differences ] 
in student backgrounds and expectations without involving 
the entire, group: . ♦ . ^ " * 

The possibiTity of confronting the entire group 1 
. early in the process was not an Option in this Simula- ' 
^« tion. That approach certainly has merit, but wpuld " 

have td be-iaanagejd with considerable skill bec^se group , 
confrontation ^could alienate some of th^ students, ^ 
seriously dcunaging prospects -for a grpup* solution* -It 
* is recommended, therefore, .that time be spent gathering 
information from thq two grbups Independently ,\pfior to 
any group discussion of the problem* The r,ecommended * 
solution would be different if the course had "been in 
^ the sixth* or seventh wfeek* f In that"tase,^n .immediate > 
and direct confrontation with'thiB .entire .group might be* 
necessary. ' - ■\ 

^ The decisipn to provide mOre^idac^ic material ^Iso 
has- mefit. A brief presentation at the start of each 
group^ session v/o^ld botl^* help foqus* discussion and allay o 
some of the concerns of the unhappy students. If this ' 
, technique is used, .it. is be^t to have the students jftre- • 

pare and make the presentations.^ This technique* should 
' be used sparingly, however, since the- primary purpose of 
' srrrdli gro^jps is not to present new informatidn but to 
V - develop student skills in applying information they al*^ 
ready h^ye, and- in solving- medical problems* , ' 

The gffer^to. assist these three ^students reflects 
a genuine , concern for their situation.' 'In this approach, 

li* however, the assistance would address "only the cognitive- 
aspects of their education, not the. underlying "problem 
of their limited ability to/interacty^ in a group learning 
situation.^ It also tends io -emphasize a teacher-cen'Jiered 
approach to Education where the instructor is the cpntent^ 
expert. A potential value of small groups is that stu-, 
, dents can alternate between the rolei of teacher arid 

, student, as discussioijs .relate to th^ir areas of comper 
tence, w/th the result that -they betbme more actively . 
involved and. consolidate their own thinking.^ * 

• The .suggestion that, thfese students v^ill simpj.y out-- 
^ grow their anxieties is unwarranted in view of the ^ 
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background pf^ tHese students.. Further,' this ^approach ' 



denies that *the f apult^< member t^hadres responsibility^ fox 
'the sycc-esS" of ^thk .gxoiu)/ and should be prepared, partlcu- ♦ 
larly 'ii^ -the early ' staj^e^ to provide necessary leadership 
and direc1;iQn. ^-*SilnilarJ.Y^^^ refcomrfterldation that* the* 
student tfarii^j^j^'^ftl^tf viewed as^^a last resort; ; While 

it is true, that' n^otl everyone "^finds the^small group' format 
compatible with his/her needs, it should be determined 
first whether /tUis is the ;case or whether the -g-roup , 
functioning ''poorly . Unstructi^ed, unorganized group- 
'sessions'- will degenerate ;into meSftifigless "bull" sessions 
,and ultimately iri^strate "all' participants. Thei^e .must be 
stated objectives and a pl*an for managihg each sGssibn.-- 
3tudents and faculty should not be deceived into' thinking 
that pimply tp^^meet around a* table as a group responds, to 
student learning needs. If the 'group is - functioning' wdll ; 
and students still canlicJt relate to this approach,, trans- 
ferring to a more^ traditional legture^ section mig^t .be- ^. 
appropriate, althougkr iirdoing so they may be denied- the 
possibility of developing sdtnfe skills .they will need in . 
the future, si^ch as tiie^capacity to expresgthemselves / 
cLeariy dnd think through prohfTems systematically. 



CONCJ^uaiONS ' ' ' - ^ ^ ^ 

The. pr.eviojas. analysis and discussion stiggi^t that; 
while small group teaching is' a coiflmonly used method, !> 
there are Spme fundamental issues, that heed to be.^ addressee! 
to assure i-ts ef f ectiVe*-use . . - • • ' ' 



The Primary Areas' of Concern 



1. * Most faculty aire not thdrpi^gh In their 
management .of this educa^tionai' process . 'Fifty-two percent 
(#52%) maJte no attempt tl^ understarid -the pauses of the 
students' difficulties, and'#85% do, hot cbllejct informa- 
tion on why the other students ajre relatively satisfied. 

2. There is little evidence of faculty collab- 
orating with their colleagues in , resolving educational ^ \ 
^problems. Eighty-three ^percent (#83%) do'rtot seek any/ . 
advice or share their problem with their p^ers.' . , 

3. Many faculty dp not seem to understand the 
d'i'ff ic^ulties students can h^^ve leaprning in ' a small group 
setting. ^Twenty-eight' perdfert -(#28%) treat the;' problem 
as. unresoivable, while anotj^er* ^13% act as though ^here.. 
AS no proBlem.4 • * 
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Ericc^aging, Findings 



1/' Almost liaTf the faculty '{H8%) are. at .least 
willing^ t^o take the stude^ts seriously -and offer to \*ork ' 
with , them on their problems. While th'is is not the 
optimal decision, it* does \indicate th^t faculty accept 
their share of responsibility for the studen'ts' education. 



. ^ ^2. ^ Appiqximately one- thirds express ^n Interest 
in attending a workshop on smlll grou$r\-^e^chinf ^ 
ently, they haveMpme self-identified ne^S^.tW 
address. / , 
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^ y • TABLE 26 ' ^ 
DISCUSSION WITH TH.REE DlSS/yTIS^'IE'D STUDENTS 



j_ 



yOTAL. POPULATION 




* — I 


SECTIONS 






TOTAL 




DESCRIPTION' OF OPTipNS 


E 


K 


N 


0 


X 


AA 


DD ' 




h r^. 




















1 Att;itude toward group 
process 








0 


'a 


" '0 


21 


'32 




2 Expectation for 
* faculty rble' 


1 


3^ - 


7 


0 


1 • 


0 


27 


.39 




3 , .Academic ba'ckground 




3 


5 


0 


1 

4 


i- 


19 


30 




4 Prior GXDeripnpe in 
sipall groups 




4 '-'^ 




0 


1 


0 


24 






5 Progress in other 
^^classes 


I,. 


, 3 


7 


0 \ 


0 


0 


23 


34 




k - 

* * / 

'6 Opinion* of group / 

structure ' ' • / 


1 


4 


ft 

6 


0 


0 


1 


29 


\ 

41 




7 Feelings of identity 
with group / 


1 


2 , 


5 ^ 


0 > 


f 

0 


0 


16 




• 


0 . ResponsiJ:a-lrir6y for 
lea^?f!ing of others 


^1 


3 


5 


0 


1^ 


1 


22 


^ 33 
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TABLE 27 
FACULTY CONSULTATION 



TOTAL POPULATION 



DESCRIPTION OF OPTIONS 



1 Recommend transfer ^ 

2 Reassure students 

3 Offer to assist students 

4 Arrange. for educational consult- 

ant 

5 Modify current formats 



SECTIONS 



5 
3 
7 

4 
6 



2 
3 
3 

2 ^ 



0 
1 
1 

0 
•0 



4 
6 

4 

6 



4 FF 



/TABLE 28 

DISCUSSION WITH SEVEN SATISFIED STUDENTS 



^0 
0 
0 

0 
1 



TOTAL 



17 
f 

10 
15' 

















1 




TOTAL ' POPULATION ^ 








SECTIONS / 








DESCRIPTION OF OPTIONS 


F 


0 


P^ 


T 


W 


BB 


CC 


TOTAL 


1 Prior experience in . 




















small groups 


2 


^ 1 


0 




3 


1 


2 


1 


10 


2 Academic background 


2 


1 , 


0 






1 y 


2 


1 


10 














9 








3 ' Attitude toward group 




















process * ( 


2 


1 






3 ' 


1 


2 


r > 


10 


4 Feelings Af identity 




















witlt qroup 


2 




^0 




2 


1 


2 


8 






f 
















5 Procuress in other 
















» 




Glasses 




■ 1 


. p 




^ 2 


'l 


2 


1 


9 


6 Expectation for 




















faculty role , 


2 




'0 




3 


1 


2 


1 


11 


7 Opinion of group . 


















• \.' 


structure ' ' ' 


3 


2 


0 




3 


2 


3 


1 


14 
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Standiird Errors for the "Small Group Discussion" Simulation * 

I - ' ' > * * ' ' » ' 

^ OPTION STANDARD ^RROR OPTION ^ STi^NDARD ERROR OPTION STANDARD ERROR OPTION STANDARD ERROR 



Al 
A2 
A3 
A4 
Bl 
B2 
83 

CI ' 
C2 

C4 • 

C5. 
C6 
C7 
01 

02 / 
EK' 
E2 
E3 

£4 " 
E5 
E6 
E7 

E8 
Fl 
F2 
F3 
F4 
F5 
F6 

Gl 

G2 ' 

G3 

G4 

G5 

HI 

H2 

H3 

H4 

Jl 

32 

J3 

J4 

K2 
K3 
K4 
K5 
K6 
K7 
KB 
K9 
KIO 



2 
2 
*1 

. 0 

1 

J 
1 
1 
1 
1 

' ,1 

1 

V 

1 

0 
0 
0 
0 
0 
0 
0 
0 



\ 









Kl 1 


0 


Tl 


> Kl 2 


\ I 


T9 ' 


L 1 


-1 J 


L2 


, 1 


T4 


L3 


1 


TC 


L4 ^ 


1 


76 


L5, 


0 


T7 


fl t > 


» . ^ 


TO 
i O 


M2 




T9 


M3 


? • • 


Ul 


Nl > 


> 1 


U2 


*N2^ , 




, U3 


N3 




U4 


N4 1 




. U5 


Mo 




UD 


N6 




-•'U7 






1 lq 


idD 

. No • 




HQ 

uy 




'i ' 1 1 


U 1 U 


fjjl 0 


1 


V I 


N 1 1 


' n 


\/9 




♦ 0 


V J 




n 
U 

n 
U 


\tA 

ut; 
vo 


03 


6 


W I 


04 


, 0 


W2 


Ob 


u 


W J 


06 


0 * 


W4 


07 


0 




no ' 
Oo . 


0 


Wb 


0^ 




W7 


OlD 


0 


WB 


01 1 


0 


wy 


PI 




A 1 


D9 
Y L 


U 


Y9 


tn 
• HJ 


n 
U 




P4 • 




X4 


P5 




X5 


P6 


• 0 


^ X6 


P7 • 


0 


.X7 


Pff, 


a - • 


X8 


P9 


0 


• X9 


PIO 


0 ' 


^ XIO 


PJl 




Yl 


Rl ' 




. Y2 


R2 ' 




Y3 






Y4 


R4 

si 




Y5 
Y6 
Y7 


S2 




Zl 


S3 




22 


S4 


0 




S5 


o . 1 





07 

0 
0 
0 
0 
0 
*0 
0 
0 
0^ 
0 
0 
0 
0 
0 
0' 
0 
0 
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INTRODflGTldN / 



VI. LECTURING 



Faculty membefrs in United ^ptates ^medical school 
report that lecturing is a commonly, used teaching 
method; #^6%58 use it frequently, and another #33%'^se 
it occasiojially . Few of them haye had 'training in 
lecturing techniques. -Only 416% hav^ taken courses /in 
teaching methods (which, presumably, would include' ' 
lecturing) / and only #25% have attended workshops * ifi thr^' 



area 



60 



Thirty-seven percent ('#37%) reported that they 



would like to receive printed materials about lecturing 
and^ another #31% would like both' to receive printed 
materials and attend a^ workshop on' this^topic. 



i! 



KEY*" FEATURES OF- THE- SIMULATION ^ * ^ . ' 

The three pyrpdses 'Of the^simulation are: 

A. tQ de^termine ^ which 'sources of information fac-' 
ulty members use , in av^J-uating lectures, 

B; to . determine which of a number of. serious 
lecturing pr6b'J.ems faculty members can, identify in the 
3imula\:ion, aijd . . " ' ^ 



me 



* • \C.. to identify the. methods facui€y members* recom- 
nd BS ways to improve lepturihg. 



The simulation 3lso allows the col^ction of information 
on how faqulty membe:^s "consult" 'with one another., . though 
this was not a goal o*f * the Survey ^ 



'1r ^' ' ' • 

^^For a discvissibn" of the percentage symbols in this ' 
report, see/Giifiipter 1^ -pages 9 

^^ First 'Preliminary Report s j^p. 116 , 60, 67 and 70.. 

' ^^ ^irst. Preliminary Report , pp: 57; 60,' 67, 70. 
' 61, 



First Preliminary Report;, p. 188. 
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The simulation begins as follows.: 



' . ■ .... 

Dr Stuart Brovfn IS a Voyng newly appointed fcKuftV momoer in^yoqr depariment is bright j. 
well'iratned anc^has knoWiedge anc/ expertise.ir\ an important area *tor these reasons, tfas been 
asked to give a series of three lectures to medical students as part of the mtroductory course yoyr 
dep.Tjtment offers .Yo^ are conver^nt withjhe material Dr BrQvJn is presentir^g ' 

0/4 Brown has'come toyou for help with his lectures He h^already 9iven two nnd a numbe/ 
of the-students have approached him complaining that fiis ^i^esentations; w$rg ejttrcmoly diff.cult tc ' 
kiilow You are impresst^d by*his ^amestness'and his desire to tiTiprp\/c his teachmg and on this 
basis you agr'ee to w5rk^with him . • ^ * * 

JHe tells you thai hi5,third talk is coming up shortly yid \hn\ he' doesn't expect your hefp to be 
refld:ted at tlt3l pomt Rather ,he ^xpects^thrat irficrov^men^ tj^sed on the recommond.Mions ana^ 
swggesiior^5> you;ma'ke'will appe'StAvne'n he (s ask^^d to lecture irj-ihe futw*e .a - 

• " Y/)u begin by,(CHOQSE OnIy ohE) 

""^r. • • ■ • 

.'Al« Talking with Dr^ Br^own in deta^i ^lit ^I5^ 



^ ' .lecturing^ . • , , ^ ^ 

* A2 Asking Dr Brown if he wOut(3 m^nct yoy^ 

^ *^ ^ tali^ing .vith. some studerits* who attended 
♦ hw lectures ' , ' ' • m 



A3 Asking Dr Browfi'if yj^ can stl fti on Fiis 
• thij-d iettupe 



^4 Looking (Jver t^e'notes from wtiich*^;)r. 
Brown lectuj^es * ' 



f 



Tbe opfening scene irlakes 'Li;: xleatr -that the-redpon- < 
de»ts^ to this, simifcl/ation 'liave^^n unhindered "opportunity 
to#dlscoyer Browiv^^: ^ob^ems. '^yirht, Browrt hijnself T.s 
irec^uestiag , the help" and ha«/'ncJ dfiject^Loits to the- con ' 
'sultant -using all .fqiar'^Qurces^of ..il)^formatiDn ayailable 
'in the simultition: talJcing with Browne's stUcJen^^, ^is- 
t'ussing lectui^ing* vith BroWn,.;' attending thq .third lecture, 
and e:jauiining^ Browp* S 1^4?ure- notes.' Second, B^own is to 
yivd. another lecture, aoon sg^ tbe 'c'orisul^t^nt: ha^' the * 
oppoijturiity tp obserV^ lectotQ, directly And finall^^',' 
Brown- has ,a ^ea^pnable'v expect a tioh about how long it^ 
might tajce ; for ^him to improve' his ^lectur^^ng, and is 
willing" to, let" the consultant take as mudh time as \ 
necessary to provide the ' ^e^dback /he needs • ^ * 

In. working .thirbugh the simulation, resppndents- have 
'the opportunity to collect information* which- would allow 
them to identifyr Brown* s problems, and, at the er^d-; to , # 
.recommend ways Brown can oi>ercome them. , ' 



' 'Browjci has ^ix problems with his lecturing method: 
7^ » . * , * • * 

K 'In deciding ^at to cover in iri^ lectures, * 
Brown f^ils to .consider -what ^tuderits need to know^^^^n [ 
order, to^ understand the C9ritent gf ttis^ lectures . in 
fact, .there are three concepts students mus-t have mas- 
tered (called W, X apd Y in .the simulation) , and tlie 
students feel comfortable with only x\' Brpwn (who 
determines lecture coverAg^ pretty much' on his dwn) 
would have known thaft the students were unpi^epared for 
wl>at he planned to teapt>' If He had either i:aiked to tfife 
sftudents or with faculty members who were kn9wledgeable 
about the curriculum. ... / 

. 2._. Brown does not 'consider how the information' he' 
*^is^ teachiij9 might be usecf by tlie students^ While the, 




clinical ways 'the students might use the matefi-al^ 
covered Je.g., to understand material itj other courses * ' 

they ^ill be taking).. Thexe are two problems here;'. the ' 
.material B'!;own 1^ lecturitig on is not ^ihtegrated into' 
the medical currieulum-, aiid the students have difficulty ' ' 
putting the content in j^erspectiVe. ► ' ■ 

3. ' ^ Brown, has major problems with questions, bot^i 
from' him to the students and from the students to him\ , 
^^e does not ask questions as part of his lecture (either^ 
rhetorically or addressed to the students)' and he asks 
that his. talk ^not be interrupted by /questions from the ' 
aad^encel Thus, he loses opportunities ' to find out 
when students are confused, to moni^tor their ^ogress, ^ 
and to enhance -the students ' active, engagement in the 
learning procesls. * ^ 

4. Brpwn has difficulties," during the lecture, in 
identifying and emptesizing the main points he. wishes to 
communicate. This -results both in' students missing what 
Bi^vn wishes to, stress 'as being important,' and in making 
everything seem, equally valuable. 

5. Feedback, from thp students is not utilized." " 
Brown misses cues he could use to know that things are 
amiss and fails to solicit information from the student^ ' ' 
either through the use' of questions or by talking with ' , 
the students after class. 
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6,/ Brown's deNve^y is flat, Brownfcould improve* ^ 
his lectures markedly by the *i>sq' of devices (including 
questions and clinically 'relevant pro*blein ex^ples) 
designed to attract and hold the/stu4ents ' attention. 
Such techniques serve to maintain students ' interest • ^ 
/{and thereby facilitate learning) i*n what otherwise 
'might .seem to bq dull* material', ' \ ^ ' . 

To collect the inforwiation aboyt the flaws in 
Brown's lecturing^ a respondent' should tap three sources . 
of information: talk with Brown, attend the third lec- 
tjur.e^and talk with the Students/- So.me of .the' information 
gained from eadh of the?js, sources' is redundant and will^ 
only teconfirm things already " determined from other 
sources, 'byt some of it will be novel. It will either 
be' available . only from .that source, or it will cause 
^informat^loii f roiji othe^ sources to fall into pl^ce^ The 
fourth source ^ooki'ng ovef Brown^' s; notes , provides little 
new ^infbmation. ahd can he" safely ignorfed,^^ ' , 

. • y , , *• 

MOST, COMMON ROUTES . • - . 

In this simulation, the particular or.der in w£jich 
data "are collected is o'f^ lesser import than the number 
a||d variety of data sources used.63 Thus, the number 
. of >data ^sources will be considered and each of the 
'sQurces of -information will be described ^along with the 
percenta^geB of* faculty selecting them/ - \ 

Figure 8 for example, indicates how many sources ' 
of information respandprrfts use before they gi^e Brown ^ • 
an ahcilysis ' of his teachi-ng and suggestions for how he 
might improve- ^ ^ 



' ^^The same assertion * holds true in the "real world;" 
little c^ji. be learned from le^cture , notes in comparison tb 
direct observajtion, talking w3\h .the lecturer -and inter- 
viewing students. • . ♦ 

■ ^-^Order. wil,l be considered, however, under the 
desci^iption 6f the optimal route. , • . . ". 



112 



11. 



3 
(J 

to 



u 
a. 



#50 



/40 



#30 



#20 



#10 




# 0 



r 



Figure 8: 









* » 

« 


#43 / ' 


* 




♦ 

• 




#26\ 








#19 


IT 




t 


• - 








#12 


1 


2 


3 

f 


4 

4 


^ Number of Data Sources 




- NUMBER OF DATA SOURCES USED BY T^ESPONOENTS 
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When**only a single source of information is used, 
it' is most often the observation of Brown's lecture; 
90% .(#38%), of those using only a single data Source 
select this option > with approximately equal portions 
of respondents picking the otl\er three; (See Table 30). 

Better than a quarter of the population (#26%) use 
two sources of information. , Talking to Brown and observ- 
ing tbe third lecture are/the most popular (#20% and #23% 
respectively) . The other two sources of 'data are uged 
much less frequently. 



. Only, fl9% of the population us^ 
information. The review of Brown's 
us^d least frequently, with only #3% 
Finally,* #12% use ail four sources. 



e sources of 
nape^ is the source 
choosing * this option. 



Three sources (talking^ with Brown, ^talking with 
. Brown '"s students, and observing Brown's third lecture) are 
necessary to discover Brown's problems, although the use 
of a source or the number of sources used does not assure ,° 
that a respondent will discover aLl of Brown's six' problems , 
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TABLE 30 



Population Percent4g«4-Indi eating How Often Each 
Data Source is Used by Facility Members 

r 



Number of Percent of Percentage of- Poptilation 

Informa^tion Population ' Using Each Pat/ Source ' 

Sources Used Talk with Talk'^ith Observe Review » 



Brown 



Students Lecture , Notes 



1 
2 
3 
4 



tal 



#43- 
#26 
i19 
#12 



#100 



# 2 
#20 

#1B- • 
#12 



#50 



\ *1 



# 6 
•.#15 
,'/l 2 
"%4" 



#38 
#23 
. #17 
#12 



ll 

# 3 
#12 



-#90 #18 



A', Observing the Lecture 



Of the, three nt^in sources of information"^ observing 
^e lecture is chosen most frequeiftly by faculty '(#90%) , 
irrespective of ^how many other sources ^they use. All 
options in the sections on observing Brown offer infor- 
mation which is useful in diagnosing the weaknesses in 
lectures generally. In this case, though, some of the 
Qptions are essential for identifying Brown's particular 
problems. For Sample, the, observation that Brown's 
delivery is flat could be based on the information pre- 
sented at the beginning of each section (underlines ^ 
added) ; ^ , j . 



tee 4rg 
Drmgl 



Your 'mpr.jss ons of Dr Brg/ n as a Ipc^urer a-^^ that ^^e is busines«^likp and con^ s'ent- 
therp 's o '-^ng'ion -n hi3 manner as ho talks Irrout^h the material he is covennri Yoj h<i •■^-th 
na; r-^Dp'Cdcnos "■'ctu* ng witn thn c^mo sincertty se"se of purpose and int"n'^,ity t^>al 
ng'S to I- 'S research 

You a'SQ observe that he speaJfcS cleartv and var the ptich and ton^-' of "^i*^ 
Simiiaf'/ >>" -'ay:^ behind tn^ pcd jti a n^] rr-.o/e^ i^cun^ v<^ rv ' Mje 

DLrtnq ineKJalancp of tne lecturi 
APPROPRIATE IN ANY ORDER) 



'•tie* 



you would -jKe notice Of (CHOOSE AS MANY AS ARE 



1 The*vav tne subi-^cl ^^att^r of in*; !eQlu>re 
IS organized 

2 His def nitions of new •grns and expiana- 
t.af>s of concepts (prmc plesj. 



Cont'd. 
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Lecturing Simulation Continued. 

■ . K ■ ' 

, - 3 His fespcfise to questfons from the stu- ' 

dents and the way he handles questions f 
, \y from them 



4 HOW he identifies and stresses mam 
points m his talk • ^ 



1 



5 His us© o< interim summariesJhroughoi 
the lecture 

\ His use of formal and i^'fc/mai ^f'p'lback 
from ihe students on Kotw^the lecture is , 
' progressing 

7 The students oettfe^vior during {hp lecture 



8 His us^ of examples and^robleTis dem- 

onstrntmg thp concepts 'pnncpi^'Sl'pre- * • . ^ 

senled > ^ 

* 3 Hi<*usf^ ot h indoijts JudiQ^isua' 'nds the * 

blacKboard^and demons'^ations ' ♦ f 



• " Confi^ining evidence of ^Brown's monotonous delivery 
is available to the 90% (#81%) chooaAng option 3, -and 
the' 93% (#84%) selecting option 4, Relatedly, #80% 
^ leaflS^tiiat he uses few eicamples and no problems (option 
'8). 

Eighty 'percent (#72%4-- and 89* (#80%), respecti^e^, 
select options 6. and 7 a^id learn that Brown is pcetty 
much unaware of his audience, arid that increasing numbers 
in his audience. "give up," . ^ 

On the* positive side, 88% (#79%) choosing option 2 

learn .that Brown's definition of technical terms and 

explanations pf concepts s6em precise and technically 
correct. Helbases his definitions, however, on concepts 
W, X and Y, two of which axe. uniamiliar to the students. 

Thus, after the lecture is over, it is possible to 
draw several conclusions: Brown's lecturing manner is 
fairly dull, he makes no use of feedback from the stu- 
dents either by noticing that the^ are confus.ed and 
bored or by "probing" them to find out if they under- 
*^ stand his presentations, he does not emphasize the major 
points during the lecture, no questions are a^ked 
either by the lecturer or members of his audience, there 
are few examples, and no problems are presented to the 
students, ' 
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' Of the #90% who observe the l^ecture,^^ 86% (#78%) 
r^ognize that lecturers should generate enthusiasm ^ 
^about the^ir subject, and 61% • (#55%) see. this as one of , 
Brown's problem^. He-troulS do much, toward OYerc)Dming 
his difficulties through the use of questions, problems 
cind talking with th^ -stmdents . Seventy-nine percent 
(#71%) recognize that asking questions of students 
contributes , to lecturel quality, 89%> (#80%) believe that 
students should be'^allowed to aski questions, and -88% , 
(#79%) feel it is important for the lecturer to check 
'with the students to verify that they understand complex 
-materiai. Further, 78% (#70^%)^, 83% (#75%), and 86% (#78%-) 
respectively, recognise that these are aspects of Brown's 
problem in failing to secure fisedback f^rom students. 

. Nearly all ('9 7%) those who observe the lecture (#88%) 
report that emphasis of important points contributes to 
lecture quality, and t)nly slightly ' fewer* (86%, #78%) -see' 
this as another of Brov/n's problems; A Smaller percentage 
(75%, #68%) recognize that interim sununeries in the lec- 
ture serve the same purpose, and that Brown does not use 
th^m (73%, #66%) . . ' ' 

Finally, -respondents note Brown's lack of use of 
qu^stiorxs, problems and examples. Eighty-three percent 
(#75%) feel that presenting problems to students contri- 
butes to lecture quality, and 80% (#72%) notice that 
Browrl does not use ithem. Eighty-nine percent (#80%) * 
assert that e^amp-les contribute to lecture quality, and 
85% (#77%) report that clinical applications (including 
clinical exciftiples) should be emphasized. Eighty-four 
percent (#76%) and 85% (#77%) feel Brown has difficulty 
with these two aspects of lecturing. 

B. Talking with Brown . ^ ' . 

The second most popular source of information is 
talkipg with Brown and #50% of the faculty use it. ^rom 
that meeting' (see below) , it is clear that Brown has had 
no formal training. a teacher, nor any strong teaching 
role i^odels to emulate. But, more important for the 
difficulties at hand, it^ is' clear that Brown spends little 
effort deciding what to include in his lectures. For 
example, -90% (#45Jk) learn that he identifies topics by 
reviewing^ his own class notes (option 3) , while 3 8% (#19%) 



64 ■ ' . 

Regardless df what other data sources they use.(?. 



116 



i2l 



'es<\«r n "but conuunt^ nt.j'iv no in^tructiO" or i. x;. t c m 'cftih««g hly sJV^"*tr fi v> n- c 
' 'Ctufoa D'Tuf bu! ru-> n ism idf prPMMiijiions v f." i riuL nuH'fin tptfputsug^e conversai q'* 
uy i^MHo (CHOOSE AS MANY AS ARE. APPROPRIATE IN ANV ORDER) 

t M^A rv *' erb u'v>oul U ichtnq ^no/v tmpor I' 



4 



.1J ' MM 1 ' 



0 



L^tUrr'S ' 



4 D'd ',ith stuaents nbout ^hnt to 



CO in me '* cubes'' 



no., '10 "no I'^'^.ns taui'^t 'eNite 'o t^p 
H "a,«/\dq^ jna lis needed : 



'7 .Vhit should c!u dents gahi trom the 
• 'eMu^p sprtes ue ho a a 'it ihe/ t > 

^ canqed due to ha'.'nq att> "d^d ^nd 
iej'ned 'rom the 'ectures)'' 

^'"'S W^re th^^ students toid //hat th(?v s^'ould 
^am from •'^p lectu'es and ^hich points 
were impor'ant'' . , 

9 What facts principles skills and exppn- 
— * ences do students need m order to undPt 
stand the lectures'' 



learn he does this without finding out whether they.-* 
i^udre with tl^e student^s* expectations- . ^ 

Eighty-two serc&nt C#41%) discover that he does 
not consider whether^atudents will be able to handle 
the material he is plaming to teach, dnd he doe's 
nothing to increase, the likelihood that the students 
will pick up the main points of his talks (opti,on 8, 
chosen by #42%i . ' / . ' , 

Of the #50% who choose this section, 88% 1(#44%) 
recognize that adapting the lecture to the students' 
backgrounds is important for lecture quality. ^Seventy 
percent (#35%) see this as one of, Brown's problems. 



^^Reg^rdless of which other sources of inf6j:mation 
they use. ^ ^ 
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Further, 79% C#40%) recognize Brown's failure to consider 
.hqw his students will use the mAterialhe is covering 
and^ 87% (#44%) believ^e this is important to lecture 
quality, <^ 

C. Talicing to Students 

The third essential source ,of inf ormation' i^ talking 
with th,e students and^ .tap ^is- source (see below) 

'"^ , Tn^ :iudonts sa\tjtiey had no ads^inco inforfuation o'. Dr Brown but quicKiv conoiudf d-hr 

A u> terf ' T hey h.id expf?p<t*d turn to prf^sent infofination they could mo'd m their pott's and 
look, d fnr,,\jrd to his using handouts (whi^^fcuid niriKt not< tjkina simpler) Ttiey al' o UU vcu 
^ • that tr'"'. 'ijpod tht^ inlormation presented *ouln be js« ful lo tnt^m ciimcad) s^nre this ha^^ Uten 

'•^ r 'Sf • ) othf^r tccturcfb in this roijrsf- In pursuififj ttic conv'Tnat'ori vou wj^ld ask (ChtOOSE * 
AS MANY AS ARE APPROPRIATE IN ANY ORDEft) \ " ""^ 

1 Ho mtic^ stud'Mils alrmrty Knov\ in ' * # 

* aa r related to those iddrrs?' J in Ur ' ^ 

biQ • n s lectures 

' ? Wh'.'*" n there is a fancu of knowledge * i 

and • xperiencf^ m the class [\ e .vhetner 
* «;tu<" nts ,vary marK€dly in their back- 

Qfou i:Js) * * ' • 

J jr Rro^ n s expijnntions of con ^ 

ccp" . (prmctpt' J are lik-e 
<« ' _ ' 

4 Ho. 3' Bro • n detmos lechfTicaM* rms ' • 



5 Wr <■ '""f Dr BfQwn rt- lula'ly sum'nart7Ps 
/ impo tant pomli. 

6 The .ay D' Brown handles qu'^'^tions 



7 ^Hc/, Bro/.n dtstinquishe'- DPt\^.'PGn , ' 
mai.' and minor poipts m h'b talk 

« t 

■ 8 Ho . D BfOAn us^s examples to illus- * ^' 

. tratc r.jints ^e is making , 

9 Wha' Brov.n s manner is like ' ' ^ » ^ 

^0 His 'j'p- o< handout'^ audio-visual aids 
and -> blackboards 

B^own has identified three conceptg> X and Y,» 

as cen^tr^ to understanding his lectures. Respondents . 

-Iiphoosing option 1^ (80%,^ #28%), or option 2, .(76%, #26%) < 

learn that students gene'rally .are weak' on concepts W an<3 
Y. "^s^hey V{ill not be able to understand the material 

Browi'fsi.s presenting. / - ^ '\ p 

Those faculty members, ^"^V #24%) , who select 
option 6 learn that Brown .req.udfets tftat the* ^luc^ents 
not ask qilestion? during, the lecture. '<rhose who* choose 
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option 8,. (-71%, #24%) learn that he seldom asks questions 
of his own, and that he uses few examples, none related 
to clinical medicine. 

y 

Respondents choosing other options in this v^ection • 
collect information verifying- observations made on the 
basis of atteliding '•Brown' s lectjare or talking with Brown. * 

While only '#34% of. the faculty talk wit^ the stu^ 
dents, 88% of those who ;do. (#30%) recognize that adapting 
lecture material to the students' backgrounds is important 
"^and 79% (#24%) understand that Brown hat not done this. 
Eightymine percent (#30%) feel that Brown should provide 
studen-^s^ with* the opportunity to^^sk questions and 89%^ 
(#30%) believe that giving students a chance to ask 
questions improves lecture quality. 

All three essential sources (meet w,ith Brown, talk 
with his students, and observe his lecture) were used by 
#22%, thougih larger percentages used pairs XDf sources, 
as shown in Table 31. , . 

• TABLE .31 

Percentages of, the Population Choosijig Each - 
Pair of Data Sources 

Pair Examined " • Populj^ion Percent^ 



Tal1< with Brown/Talk with Students #25 
Ta^k with Brown/Observe Lecture^ j #42 

.Talk with Students/Observe Lecture , #29 



Af ter , faculty members finish diagnosing Brown's 
probiems , ^ they are asked to (aake recommendations on how 
he might improve^his lectures. The percentages choosing 
each ojftion are shown in Table 32. . * 



4 119* 



4 

4 



^ / , T/ABLE 32 

Percent of the Population Recommending 
Each Method of Improvement 

Method of Inyrovement ^ Percent of the Population 



Rl. Read about lecturing techniques tn 
^some puyic speaking ana education 
'texts, and in edifcation journals. #52 

R2. Read about lecturing in medical , f 

education journal articles. - #56 

,R3. Talk with competent lecturers at^ 

the medical school about how they * 
lecture. , #75 

R4. Talk with students about what they 

look for in a lecture. #79 

R5. Sefk assistance from an educational • . ^ 
specialist about how to impro^re his 
Ifecturing. ' . #53 

R6. Observe people recognized as being 
good lecturers and then try some of 
their" techfiiques. ^93 

, R7. Go over the lecture notes more 

. thoroughly ir> order to be better s 
prepared.' ^ ' * « # 34 

R8. Work with you (you will observe him 

and give him feedback) on his lecturing." #74 ^ 

R9. Arrange to give some additional lectures 
* % in order' to gain experience. # 71 

RIO. Arrange to have his lectures, videotaped 

so he can review his own -performance. # 88 
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OPTIMAL ROUTE (^ee Figure 9) 

As previously "-St a ted, tfie particular order in which 
data are collected in this simulation is. of lesaT impor- 
tance than *tne. number* and var'iety of data' souiTresv 6b 

To collect enough data to diagnose Brown's problems 
accurately it is necessary to observe the- lecture, talk 
'to B^own, and talk to the students. Twenty- tv/o percent 
(#22%) used all three sourc'es. 

After respondent3 have finished collecting informa- 
. tion, the next *step is the identification of^ Brown' J> 
problems (section T) . Twenty potential problems are 
listed in tMs section, and respondents are asked to 
. indicate whether each is important to -lecture quality, 
and whether eac?h applies to Brown.^ The options pertain- 
ing to Bi^own'^are displayed in Table 33. 

• There is,* considerable agreement* among faculty mem- 
bers concerning the eleven options corresponding to 
Brown*' six' p^roblems.^ The least agreement, 83% (#18%), '* 
concerns using interim summaries (optioii Tl7) as a 
necessary attribute of lectures, and lettina students 
know what the lectures will cover (optioai T3, 76%*(#17%). 
Nevertheless, both of these values are. high, and support 
the conclusions that facul-ty using^the three ^essential 
sources are ayare of r>the attriiputes pf good lecturing 
as they. apply to Brown , and are able< to identify thef 
problems Brown is hav^^ng. 

J ' 

^ The next step, theli, is recommending to Brown how 
to improve his lecture technique. Almost all of these 
faculty members (97%, #21%) suggest that Brown observe 
som^.good leqtiurers. This suggestion may reflect the 
way piost of the pppujation learned to teach; #90% report, 
that watching o^er teaphers contributed to the way they 
currently teach?|^ ^ Eighty-seven percent (#87%) suggest 
that Brown also talk with competent lecturers,. 



66a cohsequenc.e of this situation is th^t the "opti- 
mal route" is not a single 'route and cannot be represented 
in a separate figure. ' * 

^ ^^ First Preliminary Report , p. 99. 
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^ TABL&'33 . 

Brown's Lecturing Problems and Percentages of Respondents 
Who Recognize Them^ 



Brown's Prpblem 



Section *T Options 



Percentage Imllcatlng 
That the Option is * 
Important-to Lecturing, 



Applies to 
Brown ^ 



1. Failed to cpnsider what 
students needed to know in 
order to understand the 
lectures. < 



Tl.^Lecture con£fent should 
be adapted to student back- 
grounds. 



93 ;(#20) . 



79 (#17) 
\ 



2. Failed/to consider how 
the Information presented 
might 'be' used by students. 



T18. Whenever feasible, the 
clinical application of the 
iiHteriaV should be empha- 
sized. 



93 (#20) 



90 (#20) 



3 Failed to use questions. 



T7. tecturer should engage 86 (#19) 

the students through the 
use of questions. 

T13. Opportunity should be 90 (#20) 

provided during the^lecture 
for student qi/estions. 



84 (#18) 



85 (#19) 



4. Inadequate identifi- 
cation fcnd emphasis of 
♦main points^ in the lec- 
ture. 

4 



T3 Students should be pro- ''93 (#20) 

vided.with an understanding 
of what the lecture(s) will , 
cover.* ' - . • 

T5. the lecturer should 99 (#22)^ 

emphasize the most important 
points in the lecture. 

T17. Sunnaries-should be 83 (#18) 

interspersed throughout the 

]ecture.^ 



76 (#17) 

88 (#19) 
« 

81 (#18) 



5 Failure to utilize 
student feedback. 



T16 Lecturer should check 
with students to assure that 
complex material is being 
understood. 

(also see T7 and Tl 3) 



91 (#20)^ 



89 (#20) 



6. Flat delivery. 



T8. Students should be chaU 86 (#19) 

lenged by -problems dealing 
with the subject matter. 

TIO. Lecturer should generate 91 (^20) 

enthusiasm about his/her subject. 

T12. General pov*ts should be 94^(#21) 
illustratedr-with specific examples. ^ 

(a.lso see T7 and PI 3) 



81 (#18) 

87 (#19) 
90 (#20-^ 



^®These statistics apply only to the §2ZX who collect data by observing Brown* talking w1*th h1m» and * 
talking with his student^. 
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^"Ninety p^rcent\(#20%) recominehd ,that Brdwn ^alk with 
students ^about what they look or in a lecture. This 
sugges tioii' also, probatly reflects tRe experience . of the 
•fykcuLty generally; #97^% report' that students have contri-s 
but^ to the way they curj^ently teach , . #83% seek 

-staintre ,at'least occasionally from current^ students , 
^^andl[f3% from ^former ones.-"^'' Finally, S9%t (#20%) recom- * 
mend t^hat -firowif have his leotures videotaped so, he can 
^re^^^;^ew-^his own perfonrianj:^^ Thi^' is. a rather high 
per centjage, ' considering^ that only #42% report having, 
had experience with videotape as a teaching tool.'^^ 

Some potential 'sources of improvement, ^re recommended 
less frequently. ' Reading about lecturing or public 
"speaking in geTieral and medical education iiterature^ is 
suggested by only 58% (#13%) . This is a small percentage 
considerinc[ that. #88% report that educational- literature 
has •cont-r'ibuted^ to 1;heir teaching, and #73% state that 
they seek assistance, at te^t occasionally, in "the 
litera-ture. " -perhaps, faculty consider "the literature" 
tp be ^^ources^ of information on content, such as th#y . 
woul(^ *'fihd in 'the New England Journal of Medicine , which 
J^82% report that they read. 72 

- Fifty-eight percent (#13%J suggest 'that an educa- 
tional consultant should be contacted tq help Brown 
improve his lecturing. Only #26% of the faculty, hov/- • 
ever^p report that they themselves use such a source. 

'Most of the faculty members who pursue the optimal 
route '(80%,'' #18%), volunteer to work with Brown to * 
iraprove his lectures. This is not a su^rising finding, , 
considering that #'93% report they turn to other membeirfe 
of their departments,^ at least occasicyially , for help. 73 



^^ Fj,rst Preliminary Report , p. 9$. 
70ibid. , p. 137. 
"^^^bid. , p. 125. 
"^^^bid. , p. 83. ,.^<^' 
■73ibid. , p. 136. 
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Better than two-thirds, 68% (#15%) also suggest that - i 
Brown should give some additicg^l lecttires to gain experi- • *' 
^ence. ■ Going over th$ lecture^:lfc was the one suggestion 
made infr^uently; only- 33% (#7%) believe Brown's lectures 
would be markedly improved on the basis of this activity. 

As mentioned 'earlier , the lecture simulation alsa 
provides data on how faculty members consult with one' ' 
another^, and analyzing the order in which various infoi;- 
mation sources are used, the percent of the population 
using the - recommended ojrder can be estimated. In good 
consultative practice, this order would r'fequire the fir,st 
activity to be talking to the. client to become' acquainted, 
to reassure him of the good intentions of the consultant , 
and to familiarize him with the naturae of the information 
sought. Analysis of data from t'he ^simulation ^hows that 
few faculty choose ' the proper" route: only #1.7% talk' 
to Birown before using othbr infprmation sources. Their 
diagnoses and recommendations, however, do not differ 
markedly from those of other f aculty^'^rfo use these sources 
in a different order. .(See Jables 34 and 35.) 

CONCLUSIONS 

Based on the results described in the preceding 
pages, a number of conclusions can be drawn about the 
way faculty members view lecturing. Note, though, that 
these conclusions are based on somewhat indirect evidence, 
as the respondents were acting as "consultants," not as 
lecturers,, per se. 

A. Primary Area^ of Concern ^ - ^ ^ 

1. Large portions of tltfe faculty miss valu ^ 
sources of information bearing *on the success of lect 
For example, ojil'y about a t^i^d consider the audience 
the^lecture. • 

2. Potential sources of information on lecturing 
(e.g., educational literature, educational specialists) 
are not yalued by faculty in this situation. 

3., Only about one third of the faculty members 
include the assembly of student-views when trying to 
understand an instructional problem. 
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TABLE 34 



Brown's Lecturing Problems an^K^^j^^tages of Respondents (#1.7%) Who I^ecognlze Them74 



Brown's Probltffn 



Section T Ogtions 



PerQfnta^e 'indicating that 
th^ Option IS Important to 
» Lecturin,g 



Failed to consider 
wha^tudents needed 
to know- in order to 
understand the lec- 
tures 

Failed to consider 
how^the information 
presented mfght be. 
used by students. 

Failed to use ques- 
tions 



4. Inadequate identi- 



Tl. lecture content 
shou.ld be ddaj)ted to 
student backgrounds. 



T18. Whenever feasible, 
the clinical application 
of trte iMterial should be 
emphdsiid. 

*T7. £ecturer should en- 
gage the students through 
the us« of questions. 

T13. Opportunity should be 
provided during the lecture 
for student questions^ 



16 The lecturer should 
fication and emphasis emphasize the most impor- 
of main points in the tant points in the lecture, 
lecture 



81 



80 



91 



100 



100 



Applies to Brown 



78 



67 



91 



' 100 



100 



T17. Suimiaries should be 
interspersed throughout- 
the lecture. 



5 Failure to utilize 
student feedback. ^ 



6, Flat delivery. 



T3. Students should be 
provided with an under- 
standing of what the lec- 
ture(s ) wi 1 1 cover. 

T16. Lecturer should check 
with students to assure 
thit complex material is 
being understood. 

(also see T7 and TlS.'i 

TIO. Lecturer* shou'ld ^ 
generate enthusiasm about 
his/her subject. 

T8. Students should be 
challenged by problems 
.dealing with the subject 
matter. 

T12. General points should 
be Illustrated with specific 
examples. 

(also see T7 and T13.) 



100 



91 



100 



92 



94 



89 



91 



100 



77 



91 ' 



r 



These statistics apply ^ly to the #1.7% who selected the three essential sources In the proper wder. 



^ ' ' TABLE 35 

y 

-Recommendations for Improvement by the #1.7% Choosing 
' the Three Essential Sources in the Proper Order 



R\e commendation 



Percentage of 
Pbpujation 



Percentage of Those 
Selecting the Optimal 
Route 



Rl. Read about lecturing techniques 
iin some public speaking and educa- 
tion texts, and in education 
journals. 

.R2. Read. about lecturing in*medical 
education journal artl^+Bt,*.^^^^ 

R3. Talk with competent lecturers 
at the medical school about how 
they lecture. 

R4. Talk with students about whet , 
they look' for in a lecture. 

R5. Seek assistance from an educa- 
tional specialist about how to 
♦ improve his lecturing. , 

R6, Observe people recognized as 
♦ being good llcturers and Xl^en 
try some of their techniques. 

R7. Go over tha lecture' notes more 
thoroughly in order to be better 
prepared* 

/ 

R8. Work with you (you will observe 
, nim and give him feedback) on 
his lecturing. 

•R9. Arrange to give some additional 
lectureSi, in order* to gaiij' ex- 
perience. * 

filO. Arrange to have his lectures 
^ videotaped so he can review his 
own performance. 



... / 




# 1 

# 1 

_# 1 

# 1 

# 2 

t 

# .3' 

# 1 

# 1 

# 2 ' 



62 

58 
74 

73 
46 

TOO 

19 



J 



1^ 



63 



96 



^-126- 



Encouj^aging Findings • * 

Faculty members ^re generally able to iden- 
tify major problems iiy71ecturi;ig-, at least when the task ^ 
involves selecting, from a prepared* list • ^ 
« 

2. Faculty §embers employ direct gbservatidn 
in analyzinc lecturing problems, , , ^ 

3. Faculty members believe that talking with 
students and colleagues recbgnize^ as good lecturers is , 
a valuable way to collect information on lecture improve-- 
ment. . ^ ^ 

4. Faculty members seem' generally willing to 
assist their colleagues .in ' improving their lectures. 
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TABLE 36 



* CONSIDERATIONS KHIi^E l!(tfERVIEWING «ROWJ 







L 


^ /' 

SECTIONS 




TOTAL 


h^-> 


* < * 

'TOTAL I>OPULATION 


J 

M 


G 




E 


1 


Brown's attitude tpward teaching 


8 


19 


10 


3 


— — : — 

40 ' 


2 


Did he admire any teachers 


5 


14 


6 ' 


3 " 


28 


3 


Procedures for select3;pn of 
content 


11 


21 


10 


3 


45 ' 


V 

' 4 


Reqtiesting, students ^ input on 
lecture content 


3 


.9 . 


4 


3 


19 


^ 5 


Requesting colleagues input on 
lec;ture content 


9 


19 


9 


. 3 


.40 , ^ 


6 


Relationship between what he 
teaches and what is required 
of physicians 


9 




8 


3 


38 


8 


.What students are to gam from 
the lectures 

Comnun 3 eating important points 
to the students 


10 
10 


1 

21 


8 

• 8' 


3 

• 

3 


44 
42 


0 


Determining "rylevel skills 
and i^owledqe ^ 
\ 


9 


\ 

20 1 

1 


9 

, i 


3 


41 

1 



1 
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TABLE 3.7 

CON'MDFKATLONS WHILt OBSERVJNG EROm 









SF'TIONS 




TOTAL 




TOTAL POPULATION a 


Y 


N 


K 


s 

e ' 


1 

» 


\ 

iiow hf organizes thfe subject matter 
How he d^. fines terms and explains 


69 


0 


2 


9 






concepts , 


66 


9^ 


2 


2 


79 




lk>w he handles questions 


68 


.9 


2 


2 


81 




How ht stresses main points 


72 


8 

• 


2 


2 ■ 


84 . 




'.-.tuth.^r he uses interim summaries 


58 


7 


2 


2 


69 




M.'w .u' usei> ->ludents' feedback 
!(;w ^'tuitent> beliave dVirin^ the 


'61 


8 


2 


1 


72 




lecture 


67 


9 


2 . 


2 


80 


« 


9 

H« w he uses exdinplcs and 














r^rolOem.s 


69 


8 


2 


1 


80- 


9 


'Hj>w he ust .s handout', and * ' 














^tud luvi siial aids 


70 


9 


2 . 


2 


83 



/ 

* I 




\ TABLE 38<^ 

CONSIDEP^'. luN^ WlilLE INTKFVIEWING BROWN'?: JTIJDKNTS 





SrCTIONS 


TOmL 


TOTAL POPULATION 


J " 


w 


I. 


c 


1 How* mueh do thfjy know in cirGci'^ ^ 


4 


X3 


9 




^ • 

28 


/' ; "^L'-i'i< 1. 1 s vjry Li» rnc DaCK.*>jrounKis 
tV.y h.tve 




^ 12 








J Ari- Hrown'b expl and t: i oiis unde.r- 


6 


10 


8 


2 


26 




4 




7 


'2 




I H 1 r. • 


" 6 




7 


2 


24 




5 


-10 


7 


2 


24 


' \ ( ,^ i-if.v* udoTit 1 f I*", major :H>f..t , 


• 5 


f, 


8 


2 


24 




6 


Q 


7 




24 


10 l">W IvTf^WM U .''•S liM i 1 OV I L>ua 1 ^\ . 


4 

J 


10 

9 


b' 
6 


2 
2 


/ 24 
22 


* 
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TAPLE \i 

CO>^SiDERA-iIi)NS WHEN RhiVIEWlNG BROWN'S rtOTES 





SECTIONS 


Total 
















TOfAL POPULATION 


H 


IT 


0 


K 






* • 


2- 


3 


7 


3 


15 




^ }'.)w p'portaiit points are identified 


Z 


4 


X 


4 


17 




) iiow h,,' plans to use thti iiotes 


2 


4 


7 , 


3 


i§ 




i^o^ thr (onc:Iusion of the tnik h{is 














prepared 


1 


3 




3 






fU^vs' ti-uimiiaJ terms arc defined 




• 3 , 




' 4 . 


16 ' 




> 

•> * .w.ittu-r questiDns .tr» included 
















2 


* 

3 


7 


. 3 


15 • 
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. TABLE 40 • 

•.ys'AL"i ;IS ('t HROv.-N'S STRENGTHS AND V£AKRESSES 



■ i TOTAL POPULATION 



; — r-:r- 

Important to 

lecture 
quality 



SECTION T 

— 

Applies to 
pr. Brown 



Does not 
apply" cu 



1 Lecture content should be 
at^Hptrd. to .student 

t ure F?nduld" be paced 
.ir<:ording to the listeniog 
^ :fad notetaking i 1 1 s of 
stuilt'nts W 

% 

^ .it i»*(lL*nL.s shoild be i|ri)v id*fil. 
with* ai\ unders t.ii^l ing of 
wlMt tiie U-rtureCi) wiH 

i:ovl r 

; Ihr Iv^'iwrrr shi'.uJd « larlfy 
, tli.it his/hc'r ro^.pon^ I b'l N 
rt I e(S. Arc Hnii t I'd Cu 

rill- lecturer siu)uld ^'^upiui-^ 
^ i/u Lbo most importan^^ 

h K\ diind.nu ft slu.>uld be 
^ :%ini'nzed t(i perz;iit 

resi'lnt^.it J on . 
7 I r[ s[^. ufd LiK.ifci' ,the 



^86 



90 



96 ^ 



32 



78 



! ei.^ed -^^r ^b] '-n- 
.n^r^ I r ~ »^ i 

I I < t-urr^lo|[r,.it^ sfi 'u Id 

: I o t lie - V 



8? 



1., 

75 




61 



51 



64 



86 



77 » 



J3 



42 



1.24 



21 



11 



26 



' 3 



21 



I. 



TOTAL POPULATION 



TABLE 40 (Co nt'd) 



10 Lecturer should generate 

''enthusiasm' abou< his/her 

11 Verb.nl presentatjLbn skould 
^ - ho supplem^p^d with 

. apprx)priatje^visuai aids 

12 Ceneral^^ints should ^>e. 

i llustrated^i th 
. specific exJ^>les 

V\ (Opportunity sliould be^ 

provided. duringj|the" \ 
" * , ♦ lecture for student " 

J^mt'stiuns ' 

J I^.ertuif mj LP rial sholild be 
orv<.inlzLHi for ease of 
v.*omprt'hension % • ' * 

Jt • _ ^ 

i')^ Ntw terms should '^bt* 
- caiL»fuJ-lv defined 

H> L(H LurtT shoijld check witli 
student s to .i>;suro' that 
^tJtoplex material is 
l)«*in>< inidt-rstoad ^ - 

\ ^ \ ' 

1/7 Sunmi.irljfM shoyJJ be ' 

' J nrcrspt rsi»d throughouf^ 
* %\\e IrcLure »^ " ^ - 
' • . " ' • 

1.8 'wini^rv^r It'-isiblf,. the 

' fiJ lnl(;\il ,ippllcaLion ol 
tue nui'ti'Tial should be. 
\«»f:»p^s^zed^' ^ [ 

19 ^ ( rmp 1 •»>. . I ssues .i^id di'taiicd 
^ I I sH s shouUirf bi^ 

il>str ihiitec hand»>uts 

20 .Conflicting data siiuuld 
he sivni Jed tn redm o 
» oji f i on- 



J' 



90 

90 
89 



89 



89 - ^ 

9b. 

,88 
73 



xB2 



39 



84 



82 



83 



55 

40 ' ( 



30 - 



46 ^ 




,3^ 



A 



r 



75 



.5 



9 - 



29 



H33' 
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•TABLE 41 

pr^OMMEJlj/.TIONS 



TOTAL. POPULATION 



KtMcJ a^our lecturing techniques 
in sMiue pMhlir t^pnaking-cand 
cd'i'/Jtion texts, and in 
rducatloa journaJs ' ^ 

Read dbout JectEurJng in medical 
oducati^n journal artiplgs 



3 Talk with competent lecturers 

ai the medical school about 
how they lecture 

4 Talk witH students about what 

they Jook for in a lecture 

% ■ 

i ^ Seek assistance^f rora aa 

educational specialist about 
how to improve his lecturing 

Observe people recognired as 
being good lecturers and tHen 
try some of t^ir techniques 

/ Co over the leqture notes more 
thoroughly in order to be 
better prepared 

8 Work with you (you will deserve 

him and give him feedback) on 
his lecturing ^ 

9 Arrar>ge*^^give some additional 

ledums in order to. gain 
^ experience ^ 

10 Arrange to have his lectures 

videotaped .so he. can review 
his own- performance 



A Probably should 
« Probably should not 



A PB^ably shoufS 
B Frobably should not 



A Probably should 

H Probably, should not 



A, Probably should 

B Prbbably should ^not 



^robably shouL 
^obably ehoul 



not 



B 



Probably should 
Probably should not 



Probably should 
Probably should not 



Probably should 
Probably should not 



A Problblv should 
B Probably should not 

/ 



B 



PFobably should 
Probably should not 



SECTION R 



51 
40 



53 
38 

77 
17 



79 
16 

54 
36 



93' 



32 
57 



74 
19 



67 
• 24 



85 
11 



\ 



134 



13^ 



TABLE 42 



ft 

OPTION 



Standard Errors for the "Lecturing" Simulation 
STANDAR9' ERROR OPTION STANDARD .ERROR OPTION^ STANDARD ERROR OPTfOM . STANDARD ERROR 



Al 

^ 

A3 




1 


H5 
I *H6 

1 


0 
1 
1 


A4 






\J2 


1 


Bl 








1 


B2 








1 


B3 










D>l 










B5 






f 


1 


B6 








1 


B7 






7 - 


1 


B8 






I J16 


1 


B9' 








]i 


CI 




1 




V 


C2 






K3^ 


1 


C3 






K4 / 


1 


C4 




1 


K5 / 




C4 






K6( 




C5 




1 


LI 


] 


*C6 






. • L2 




C7 






- L3 




C8 






L4 ' 




C9 






L5 


\ 


CTO 






' '-^ 




Dl , 






L7t 




• D2 




1 . » 


L8- 




03 




1 , 


L9 


r ] 


D4 






LIO 


1 


D5 






Ml 


1 


El 




1 


M2 


1 


E2 






^ M3 




E3 






M4 


1 


E4 




] 


M5 


1 


E5 






M6 




E6 






M7 


1 


E8 






M9' 




E9 




1 


Nl 




Fl 






N2 


1 


• F2 






N3 
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Vlt. COURSg SEGMENT DESIGN - 

INTR'ODUCTIONv ( ' ' ^ 

Th^ de'sign of a course an educational responsibi- 
lity that #92%75 medical faculty feel th^y should 
able to manage. Only #12%, however ^/I^^ve .ever taken a. 
forfhal course in instructional design and only Tf25% have 
ever attended a workshop on this topic. Of that group 
92% consider these experiences valuable. It may be re^~ 
sonable to expect, therefore^ that the approaches used by 
faculty are mor'e reflective of traditional practices or 
of their intuitive judgments about instructional 'design 
than specific ecjucational principles learned ir. a -frrmal 
manner, 

# 

In this simulation the respondent is assicjiicd the 
role of a faculty member responsible for the design of 
a segment of a . larger ' course . Apparently , this is ^ ' 
a coiranon responsibility. Seventy~two percent (#72%) 
indicate they would find themselves in a ysituatior like 
the onQ 'described , and^ #8'7% regard the simulation as 
realistic. Eighty-two percent (#82%) 'say that their 
management of this simulation's prpblem reflects the way 
they actually manage problems in their teaching.*^ 

KEY FEATURES OF THE SIMULATION 

This' simulation was designed to explore^: 

A. the approaches faculty members Use in designing 
a segment of 'instruction {h6w" they decide what to teach, 
the instructional methods I^Key use^, 

aB. the extent to which faculty b^se the instruction 
they design on- explicitly formulated goals, and 

C. the fipproac^ies faculty use 'in ^evalua^i^g the 
instructi(i?r^ provided > (the evaluation of students, the 
course, khd their own performance). 



is<:ussion of the percentage symbols in this 
'^epprt, see Chapter, 1, pages 9-10. 



The simulation begins a|^*follows« 

Your department chairman has asked you to assume responsibility lor a 9-hour segment of 
instruction dealing wijh your speciality^ as part, of tne introducVofy course your qlepa'tment , offers 
You are to plan the use of this time however you see fit You begin working by (CHOOSE ONLY 
ONE). " 



A1 Identifying what subject matter should be 
taught 

A2 Considering the instructional option^ 
available (e g , lecture discussion) 

\ 

A3^ Determining «^pier and how to evalu- 
ate the students ancj^or the instruction 

A4 Learnmg how others tn the department 
are handling tneir segments of the course 



A5 prnding out m more detail what your de- 
partment chairman expects of you 



The following is the situation that faces the respon-- 
dent: , ^ 

1. ' This is an introductory course, which suggests 
that' stud *it backgrounds are likely to vary. " 

2. The 9^hour segment is part of a larger course, so 
the instructional goals should relate to the broader 
goals of the full course. 

THE MOST COMMON ROUTES (See Figure 11) ^ ' ' 

The opening sd^t^^oresents a task which is relatively 
mhspecified. This pla^s a demand on the respondents, to, 
consider both the kinds of infonnation they regard as 
r:eleyant £o designing a couiyse and the sequence (route) 
in which they believe ttie decisions fcorvcerning this infor- 
matioji should be made. / \ 

• A. Sources^ of Inf orma^tion * ^ 

The decisions on'wh^t to teach relate directly to 
what the students are expected to l^arn. .The critical 
issue is deciding whose ir^ut will be included. Tlie 
respondent^ to Wiis simulation are given the.oppour;tunity 
to consult with students, colleagues, and practicing phy- 
sicians, in addi^ori to using their own expertise as a 
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' basis for de^idi(jig wh^t stiould be* taught (Table 43) . 

Most faculty (#87%) include their own judgements in 
making tl^ content decision. While this is a natural and 
appropriate choice, faculty designers 6f introductory 
courses need to be careful not to overestimate the readi- 
ness of students for detailed information in their own 
specialty area. One way to help assure a reasonable 
balance is to ^secure the, vj.ews of others, o^utside ^ne' s 
discipline. . 
> 

.The decision to ask colleagues about 'Wha± students 
n^d to know is made by #62% of the respondents. This is 
a?n important, decision , since it focuses on the learning 
objectives and- not simply on the teaching .techniques. 
2ixty-seven percent' (#69%) also ask tl^eir colleagues what 
they are planning to teacfi so they can co-brdinate the 
various presentations. This consideration is critical 
because it bassists the faculty in- avoiding undesirable 
redundancies and omissions. 

Forty percent ''(#'^%) include a meeting with prac- 
ticing physicians. This is an^ impressive response (espe- 
^cialiy for an introductory course); it suggests that mafiy 
faculty realize' thje value o^ relating what they teach 'to 
wh^t students need to know for medical practice.' 

The other source of informat>on ,is students: VThile 
#53% ask past stjadents what would be useful, only #26.% 
discuss t^e course* with the present class, , Perhaps the 
reluctance to discuss the course with the latter group 
reflects^ the attitude that students copie to -an instruc- 
tional experience with no background in the area an4 have 
nothing to contribute. This ignores the njped to deter- 
mine the student's entry level skills and knowl'edge , and 
their expectations for the course. 

Next'^^aculty aire asked to describe what will be 
taught. F^ifty-seven percent (#55%) produce a atopic out- 
line, while 36% (#34%) include both a topical ' outline and 
a set of behavioral objectives. The remaining 8% fl7%) 
write either a brief narrative or\a set of behavioral ^ 
objectives. Therefore, over hal'f the faculty prepare a 
proposal describing what will bd taUght (topic out^nes), 
but neglect describing how ^students will show that they 
have learned the material at a particular level of fcompe- 
tency (objectives) . » 
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TABLE 43 



* SOURCES OF INF(jRMATION ON WHAT COURSE CONTENT SHOULD BE 



TOTAL POPULATION 



DESCRIPTION OF OPTIONS 
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BB 



TOTAL 
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The ninety-six percent (#96%) who h^^^in^this route 
are next asked to choose among examinilfg the instruc- 
tional options available (e.g.^ lecture*,, discussion) , 
preparing an evaluation plan', or submitting their present 
work as a' final proposal. Seventy-seven percent (#74%) 
examine the teaching techniques available, 10% (#9%) begin 
an evaluation plan, and 13% (#12%) end the problem at this 
point. The choice between the.^irst two options can be 
debated. The decision to exclude these im.pbrtant issues 
entirely in the instructional process, however, is unwar- 
ranted. Instructional and evaluation plans must be * 
formulated beft)re this task can be considered successfully 
managed. ^ 

B. InstriKTtional Considerations . » 

As stated, 77% (#74%) decide at this point to examine 
theH.nstructional options available. Eleven percent 
(#10%) do so^ after c'omplSting- their evaluation plan. For 
the purpose of this analysis,, these groups will be com- 
bined. V/hether ^instiructional methods or e'Valuation should 
be decided first will be reviewed with the discussion of • 
the optimal^ route.' ^he findings presented below reflect - 
which- issues faculty consider relevant ^ to the design of 
instruction (Table 44) . 

Ninety-one' percent (#76%) inquire about the physical 
facilities available, 77% (#65%) determine the availabi- 
lity of other faculty for assisting in^the course, and 
58% (#49%) check the possibilities for producing self- 
instructional materials. ^- , 

Sixty-seven percent (#56%) talk to their colleagues 
to determine what teaching format their ^colleagues prefer, 
but only 35% (#29%) consider how the students view the 
various teaching approaches. 

The first three issues relate to the resources avail-^" 
able in support of the course and the. reasons for 
examining these are clear. The rationale for the last*^. 
two is more subtle, but they do relate directly. to 
Increasing the quality of the instructional process. 
Again, most faculty do not consider students relevant 
sources of information regarding, aspects 'o^^^ieir own edu- 
cation. ' idr^. 



TABLE ^44 
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C. Instructional Approach ^ * . 

The -next step in the instructional .design process is 
to determine what 'will be emphasised dn the cour^fee and 
hdw the 9 hours of instruction will be used. Sevfenty- 
seven percent (#74%) make this decision directly after 
determining the availability of administrative and faculty 
resources. Another 8% (#7%), however, address this issue 
only aff^r developing their evaluation plan and deter-^ 
mining the 'availability of faculty and physic^rir resources 
Since all respondents are p?"ovided the same options at 
this point, the findings for these two groups are combined 
below. 

33% (#32%) "Offer 3 hours of lecture to cover facts 
and concepts and 6 hours of discussion to consider appli- 
cations of the concepts and provide experience in using 
th^- to solve problems. VJ.orksheets will be used as neces- 
^^ry." (W2) 

20% (#19%) "Schedule 6 hours of lecture to cover con- 
cepts an13 applications with handduts as necessary. 
Reserve 3 hours for tutoring students having problems or 
interested in doin^^ further work." (W3) ' ^ 

20% (#.19) "Produce self-instructional materials to' 
present concepts and facts (these will be used outside of - 
class by the students). The 9 instructional hours will 
J|be spent in small grqup discusi^^ons of the concepts and ' 
their use in solving problems, wbrksheets will be 
as necessary." (W4) 

9% (#8%) "Schedule 3 hours of lecture covering the* . 
material to be taught and 6 hours of discussion to answer 
students* questions and consider their problems. Hand- 
outs will be used as appropria'te. " (VJl) 

5% (#4%) "Distribute reading ]ists to the students 
with citations covering the concepts ancj 'facts to be \ 
learned. Use the 9 hours of ^instructional time for sn^ll 
group discussions of difficulties the students have in 
understanding the readings and for solving problems using 
the concepts and fact's presented." (W5) \ 



Rir 



It should be noted that faculty dif felr considerably 
on the issue of how much time should be spent in* didactic 
preseritations rather than in applying 'the casncepts. • 
While thejre is certainly no formula for an optimal 
-balance, thete is some evidence thaj^ class time -is best 
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spent solving problems, using information that was - * 
learned outside bf class. . • . 

At this point, the 'respondent is asked to choose 
between submitting the final proposal or developing an 
eval€htion plan. Seventeen percent (#16%/ decide to ter- 
minate the problem. When this #1^% is added to the ^12% 
who ended t]ie prqblem alter only determining what will l3e 
taught, we have #28% who include no evaluation plan in 
their instructional design. ' ; 

D, Evaluati on Plan , ^ 

The task outlin'ed in the opening scene gives the 
respondent very little direction on how to design his/her 
segment of the course. There is^no specification, for 
instance, that a plafe for evaluating instruction should 
be included. If the focus is .on what the student is to 
learn, however, it. is necessary to determine the extent • 
to which the goals of instructidh have' been accomplished. 
-Only #72% include ^n evaluation plan. The findings 
•roBprted below are for this subgroup. 



Forty-six percent of this group (#33%) include a 
pretest to determine the sJbudents' readiness for the 
instruction. While some may argue that this step^ is not 
necessary in an introductory course, it must be noted that 
the goal of designing a course relevant to what ^students 
need to learn can best be aci/dmplished if it, if known 
where the students ^are when they begin instruction. There 
is no basis for assuming that beginning medical students 
'^1 have no backgrbund in the subject of the course.. 

Sixty-two percent (#45%) recommend that questions 
relevqint to their segment be included in 'a common exami-^ ^ 
nation of the total coufrse , 43% (#31%) decide to conduct 
their own evaluation* of the «9-hour segment, and 19% (#14%) 
include a brief quiz follov/ing each^ay's presentation. 
Thirty-seven percent (#37%) ' include^ no posttast in their - 
plans despite the two available options to do so. 

Sixty-eight percent (#49%) ask the students to eval- 
uate the 9-hour segment of teaching, biit only 25% (#18%) 
collect feedback from the students on daclf day's presen- 
tation. — ^ ' 



FQrty-nine. percent (#35%) ask faculty Colleagues to- 
critique their teaching ,-vfhile only 24% (#17%) believe 
any self-evaluation activities "Should be included in the 
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ev.aluatign prqces's. Forty perceAt (#^0%). J^ndic^te thkt 
they would not include any evaluration of instruction for 
- their '9--hour segment of the course. 'VThile a large por- • 
fcion of faculty (#72%) include some evaluation plan as 
part of their instructional des:>gn, m^y faculty -do not: 
use a pretest in this situation (^f67%); include a post-, 
test based on the 9-hour segment (#69%) ; or arrange for 
peer review of their teaching (#65%) . 1 One 'po's^ble 
explanation is that 'faculty do not view a 9-hour segment 
of instruction as long enough to warrant s'ucT:i ^aluat;ion. 
Time, however, should not be the issue. Anything wqrth 
teaching is wortK evaluating. 

THE OPTII^^ ROUTE (See. Figure 10) / 

. The rout^ discussed below is followed b:^4Jjy^of 'the 
respondents. The i^ationale ,for each ' decision is provided 
and is based on the primary consideration that any 
instructional activity must fooas on what, the students 
are expected to learn. 

The first decision inyolves the- determination of 
wh^t 'oontenf the 9~hour segment will include (Al) . There 
are six sources of informatibn available to the instruc 
tor. It is recommended tjiat all six be included, since 
*each represents a unique perspective on wjiat st^^ents: 
neecTto know. (The simulation text for this section is 
b<-low.) The two mo^t debatable sources alr€ .practicing . 
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physicians and the Students enrolled to taTe'^IIJ^^oourse . 

With respect to the fir^t. group., it .could be Argued that 
an- introductory course, part^.culayly if it is 4ji the 
basic s^ciences, need not.be directly related t*o clinical 
pr.actice.'^ A faculty rnember^s task is to Select from a 
^broad discipli/ne that Segment that s/he will teach.^vWhat 
'criteria will be used? If the genera^ goal of medical ' 
^•phool is the preparation^ of physicians, then in the 
^sign- of any course, practicing physicians .can provide 
^^a- perspective des^fying consideration. ^ 

As not^d earlier., most'- fiaculty apparently do not 
vi^w the enroli.ed students as h valuable source of infor-- 
mation on what Should b^ taught. While it is certainly - 

•'unlikely that the students will be cqhpetent in the sub- 
ject area prior to instruction, it is also improbable 
that all students ^will Be equally uhprepared for the 
inst'ruqtic^^. Askdng s^tudents what j.ntere?ts them could 
reveal diffefences in background and expectations, which 

. are. important considerations in the shaping of any ne^v* 
instructional • activity . • 

'The^ next step is to transla^ the scope of the 
9-hour' segmen-t into a written , proposal . The .choices are 
a topic puti^ine (Jl) , a brief narrative description {J2) , 
b^haviprSl objectives (J3}, or topic outline and objec- 
^€ives (J4).. The firs/: two optrons (Jl and J2) are hot 
recommended -sxnce^they fail to ac^dress what 'the ^udents 
are expected to learn. The other two. options (jFand J4) 
howeveir,, are defensible. A s4t of behavioral o^ectives 
Expresses not only what will^be taught, but also what' 
students must know or be able to do to be competent in 
this unit of instruction. ^This step assists the faculty 
in the' evaluation process by specifying what will qualify 
a^ a demonstra,tion of cpntent mastery. The* additional 
5tep*of preparing ^ topical outli|ie^is not -neqessar^y , but 
woul'd have the. value of Organizing individual presenta--' 
tAtij^ijs. ' - , 

#- ^ \ • , 

*Once learning, .objectives are specified, it is neces-- 
sd^y to decidrf whether to address the evaluation issues 
'br to' determme instructional methods .g/^T^cture , ^dife- 
cussiAn) for\ presenting the material, It. is recommended 
that the decision on ^low to present the material bo macJe 
c first. The logic is that the evaluation process s.hould 
*^o. beyond , student evaluation and include an -oValuation of 
the etibire instructional actavity (i.e., instructor and 
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instruction).. These aspects ' could easily be neglected if 
the evarluation design precedes other instructional- deci-* 
sions. 76 ^ * 

The options related to the instructional approach 
(Sec.tipn CC) embrace a broad spectrum of educational and 
administrative issues (refer to Table. 44, p. 144). All 
these issues should be" addressed with the possible excep- 
tion of checking -fjacilities^ for producing self-instruG» 
tional m.aterials, (CCS), which can be regarded as 
optional. The availability of colleagues aiH^^heir pre- 

"f^rerfcre for teaching styles well as ^he physical 
facilities will all inf^luend^Btne instructional approach. 
Spaall group disltussions , f c«^ist:ance, will require addi- 
tional faculty who are comfoy'table working with students, 

causi-ng this method. Equally inlportant is the consideration 
of 'student expectations for various instructional 
approaches. If students^are accustomed to a fairly struc- 
tured and teacher-centered approach, and small group 
discussions are desired, the students Should be oriented 

,to their role in this .new' setting . 

. The Jlext task is to^elect ^n ''approach for teaching 
the 9-hour segment (refer to p. 145). .Options W2 or W4 
are considered optimal/as. they both emphasize applying 
knowledge to-the solving- of problems. The other three 
options eitTier ignore this or*includ^ it only indirectly. 
/•/Bhe preferred 6ptions 4SLso maximize the 'value of class 
'time iby asfsisting studerfts in learning the didactic infor- 
matApn outside the cla^s, thereby allowing the 9 hours to 
be used .for ' learning the application of this information. 

^he respondent uan now either submit tfhe final pro- 
posal OP design an-' evaluation plan for the ^instruction. 
"^Despite the brevity of the instructional activity, the 
xebommendation ite tha't, an evaluation plan be included 
(AA21 . ' Again, if it is worth the effort to teach,, it is 
worth the ctdditional effort to .find out whether learning 
took place. ^ ' ^ ' 

Inhere are'three^ issues included among the options 
.for the evalua4:ion plan: th^ consideration of a pretest, 
the evaluation of studfent achievement (a postt:est)\^ and 



'^This logic applies , to the relatively unsophisti-' 
catefl evaluations ''implied in this .Simulation . Ideally, 
the evaluation Should be planned at the same time as the 
inS|^ructi^n. ' ^ 
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thfe evaluation of the instructi'on/instructor . The inclu- 
sion of the latter two is considered essential ^ while a 
pretest is viewed as optional in a course- that is this 
brief. It would be helpful ♦ however, to gain some 
insights irtto the students' readiness for this instruc- 
tion, particularly since this g-ho'tn: segment is part of a 
larger cdurse. Even an ir^formal discussion with the stu- 
dents would be a contribution, 

f> ^^^>he evaluation of s tudeh^Nldlfcrning , however, is not 
optional. Since the focus is on'^what students need to 
•learn, some assessment of their compe^nce at 'the end of 
instruction is .require.d , A comprehensive examination at 
the end of .th« 9-hour segment or. the inclusion of a num- 
ber of questions in: the course final are ^oth recommended, 
though either/one a-lonc ^s satisfactory, A quiz after 
each day's class is not necessary, especially if applica- 
tion of principles and problem solving skills are being 
stressed. These skills can be assessed informally in th^ 
small group sessions. 

77 ^ .w 

"I 

The eyaluatioH process should* go 'beyond assessing 
the students;' progress and determine the instructor' 9 
ef fectilveTiess in facilitating the accomplishment of the 
^objecti^s. Options H6-H9 address this consideration 'and 
it IS refcemmended* that' at least one of these prCccduires > 
by inciaded, (The simulation text for this section is 
below,) Optimally / input from both collca<6^uee and 

V H6 A questionnaire to bp iilled out by the 
students, at the end of each day <; tearh 
ing to providf^ feedback on how thry por- 
^eived instruction that day 
, ' ' ' 

' . ; • H7 A quf^stionnaire to di^tr'ljuted to 

students on the Inst day of instruction to 
find out how they viewed thp wnek s 
% ' teaching 

H8 . Self-report forms to he filled out hy each 
instructor evaluating his her contri- 
bution 

H9 Observation and cntique of the teaching 
by other faculty members 



77Theje evidence, *however / that a brief quiz ma^ 
up of open-ended (e.g., compl^^on^or short answer) ques 
tions does facilitate long- tent) retention. 
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students^ should be collected^ since each^h&s a, di-fferent 
perspective on instruction. This feedback- would assist 
the instructor in improving both this series of presenta- 
tions and his/her teaching in general. 



CONCLUSIONS 

The design 'of any ins,tryctional activity requires 
attention to many issues. The most if?tpoi!^ant confeidera-- 
tions are: what will be taught, how it will be taught, 
each student's readines's for the instruction, a/id "how it 
will be evaluated? ^ • ' ' 

* 

The findings from this study suggest that faculty, 
do - neglect sorre of these considerations* in the design of 
'courses or course segments. 

'A. The Primary Areas of Concern 

1. Almost three-fourths of faculty members 
(#74%) overlook -student ^"elf^sctatioris for the course aind 
#71% do no.t consider student learning* styles in rrakin<^ 
-their insti&uctional decisions. • . 

2 . A majority, of faculty (#56%) focus on the 
presentation of* basic facts without attentipn to the 
application of t^e facts in solv^ing problems. 

3. A high percentage of faculty (#60?) do not 
use objectives .to describe what the students are expected 
to learn. ' 

' ' ' 

4. Over one-fourth (#28%) include no. eva luatj on 
plan. . ' - 

5. Le^is than 'half of th^^ facuil:y (#49%) ask 
students to contribute to* the evaluation of 'the instruc- 
tors. 



B . Encougpging Findings ^ 

1. Most faculty .consult their colleagues on 
what students n^ed to know (#61%), ./and cjoofdinat^ their 
segmen^ of the course*v;ith other f acuity*" (#^9%). . 

2. Many faculty (#4J%) consult ,vrith pra9t^;cing 
physicians on what should be t^ught\ ' . • ' | 
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■ - ■ • 'i , • 

3, Over one- third (#35%) ask colleagues to cri- 
tique their teachiilg. ^ 

.Sixty-three pierpent (#63%) inclbde a posttest ^ 
at the end of instruction to evaluate ktud^t performance. 
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TABLE 45 



INFORMATION TO BE INCLUDED IN THE EVALTJATION PLAN 



» < 







« 

, TOTAL populat:[.on 


SECTIONS 


TOTAL 


/ 


DESCRIPTION OF OPTIONS 


C 


H 


L 






1 


Give no test at all 


0 • 






■ 6 


' 2 

* 


• 




uive a preuesu. 


0 


27 


0 


5 


32 




3 . 
- 


Give' a Series of daily qoiwes 
* 


0 


10 


0 




.12 


4 ^ 
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Give a comprehensive test 'at / . 


















' 1 


25 


1 ^ 


* 4 


31 
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'Questions* covering .^his instruction 
















. vouiQ de Oit une rinai exam 
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0 


5v ' 








Give a daily questionnaire 
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gathering students' views on ^ 
















the' day's teaching 
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15 
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Give a questionn^re at week's 
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''on the instruction they've 
















''received * 
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0 . 
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49 
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Ask teachers to complete 
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evaluative Felf-repart forms 


i 0 


lb 


0 . 


2 


17 






Observation and critiq^ufe of 
















instruction by other faculty 
















members 
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30 


0 


5 


36 
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TABLE 46 



SVandard Errors for the "Course Segment Design" Simulatiefl 



OPTION STANDARD ERROR 



OPTION STANDARD ERROR 



Al 
A2 
A3 
A4 

A5 
B1 
82 

CI 
C2 

^. 

C5 
C6 
C7 

^C8 
C9 
Dl 
D2 
El 
E2 

' E3 
E4 
E5 

. E6 
61 
62 
63 
G4 
65 
HI 
H2 
H3 
H4 
H5 
H6 

'H7 
H8' 
H9 
J1 
J2 
J3 
J4 
K 
LI 
L2 
L3 



1 
1 
0 

1 
2 
1 
1 
0 
0 
0 
0 

0 
0 

0 
0 
0 
0 
0 
0 
0 
0 
0 

1 

-f 
1 

u 

1 

1 

2 

1 

2 
2 
2 
2 
2 
2 
2 
1 
1 
2 
2 
0 
0 
0 



L4 

L5 
L6 
L7 
L8 
L9 
Ml 
M2 
M3 
'M4 
M5 
N1 
N2 
N3 
N4 
N5 
N6 
N7* 
N8 
N9 
01 
02 
PI 
P2 

^4 

P5 
P6 
Rl 

R2 

R3 

R4 

R5 

SU 

S2 

S3 

S4 

Tl 

T2 

T3 

Ul 

U2 

U3 

U4 

U5 

VI 



0 
0 
0 
0 
0 
0. 
0 
0 

a 

0 
0 

0 



0 
0 
2 
2 

/2 
2 
1 

2 
9 
1 

•?< 

0 
0 
0 

Os 

0 
2 
1 
1 
0 
0 
0 
0 
0 
0 





STANDARD ERROR 
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FIGURE U- ^TOTAL POPULATION RESULTS FOR "COURSE SEGHEN7%SIGN" SIMULATION (Numbers are estimated percentages 
the population selecting the option Indicated.) 
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VIM. TEST CONSTRUCTION ' 



INTRODUCTION . . • ♦ • 

- • 

Test construction is "a responsibility #91% of medi-^ 
cal faculty members feel they should be able to manage. "^S- 
Only #12%, however, have ever 'taken a (♦ourse in evalua- 
tion or testing and only #23% have attended a' workshop on 
that topic. There, is interest in learning ab6ut these 
matters; #49% of the faculty wou]i| li;ce to receive ' ' 

printed material on test construction and an additional 
#30% express interest in attending a workshop" on this 
topic. . • 

The respondent's role inythis simulation, chaii'person 
of a committee constryctina^ final examination, is fami- 
liar to medical f aculty('1nembers . , Fifty-seven .percent 
(#57%) indicated' they would expect to find themselves in 
a similar situation and #87% described the situation in 
the . simulation as "realistic". * V 



KEY FEATHRES OF THE SIMULATION 

. ' *• * 

At least thr«e criteria must, be met in constructing 
a good achievement test. . - ■ 

A. 'Each student must be graded on the basis of. his/ 
her own merit,^ i.e., on the basis of his/her demonstra- 
tion of skill of knowledge. 

' 'B. Test questions must be straightforward and clear, 
^without ambiguity or artificial complexity. 

C. Instructions .to the students must be available( 
and clear -so that prior experience with the teacher's' ■ 
tests, ot other tests with similar idiosyncrasies, is not 
a requirement for good performance. 



78 

For a .discussion o* the percentage symbols in this 
report, see Chapter 1, pages 9-1,0." 
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The simulation begins as follows: 



TEST CONSTRUCTfON 



I 



You ha^e been askt-d to assume the pr imarv res'^'Onso.hiy f j* constructing ihe ttnal exa^^^ n^rtioo I 
tor an interdisciplinary outsQ required of all 112 second /f»-u mt dicai stujents There are two » i ( 

otrier facu'V rfiemoers "ho navr> agreed to assist ,ou T^e three o* you a*e mr>fT^oers of tite ?-?erson 

ioteruisc D nary course committee that designed the course > ^ ^ , 

The tinai exammatior Aill account for SO^'s (jt ►"ich 5'udent s grad*^ though no exphc t course ' ^ 
commTtT^ij^r school pohcy exists on hovv to assiQi^ --rades le g on tne curve pass/f^il) To'acTTnsie 
qutck sconng the t?5l should consist of 100 ODieci -e questions ^ 

The course coordinator requested that ai' tacu 'v memoers in/oived m t^rs course wr obiec- < * 
fives for the material 'hey a-p respons.D'e tor teacr '^g Tnese /.r.fjen opiectivae are a.a-iar ^ to^ou 
An ecucatic-al specialist and some students wro nav6 pre; ousiy taken !he course are aTsjj 



iiaDKe tt you choose 'o use them 
You begm wor^ oy (CHOOSE OftlLY ONE) 



» Ai Decid r-j jvho vvill take the responsible ' if 

tty '^-''r ling the t rst drStt of the test " ^ 

questions 

A2 DeC'd '*g now grades wM be jssigned 
le g on the curve, pass fail) 

A3 Detef" Tng the subject content the test 
«^<ii cc.er 

♦ \ ' 

In the opening scene, thrjee problems confront the 
respondent in tefms of the test construction criteria 
stated above. 

' ^ 1. No policy exists on how*T^o assign grades/ Crite- 
^rion A requires that <rrades.be awarded on the basis of 
the way each student 'performs without regard to the way 
others- have 9one. Norm-referenced examinations do not 
meet this criterion b'ecause tfiey assign grades ^on the 
basis of relative ranking. This is not the information 
that teachers of medical students need to know; they need 
to know that every student has attained an acceptable 
level of knowledge about the subject. In instructional 
circumstance's as described here, therefore, the respon- 
dent should choose a ^j^terion-referenced grading system. 

^ 2. The choice of persons to write and review the 
questions in the examination has been left, to the respon- 
dent'. The assurance of straight-forward and ^ unambiguous 
questions. Criterion B, usually requires review by 
faculty members other than those who wro^ the tests -and 
perhaps a review also by an educational specialist. ^ 



3. The^ respondent has not been told specifically 
that s/he mqst develop instructions about how to take 
the examination, but should do so, in fulfillment of test 
constructij^n Criterion C. • 



\ 



t 
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'MOST COMMON ROUTES (See Figure 13) 

\^ A. . Subject Matter Covgrage t 

Ninety-two peror^t (#92%) of the respondent's choose 
to begin the simulation by determining' the subject con- 
tent the test will cover (A3J . They afe presented with 
five options for accomplishing this ^ask (see Table 47) . 

* _ Eighty-five percent of the #92% choose. to review, 

' instructional objectives. They also use other sources, 
including reviewing instructors' topic outlines, (84%, 

#.77%), discussing topics with colleagues, (79%, 473%), 
creating their list of topics',' , (64% , #59%) and examining 
old tests, C41%, #38^) . • 




ERIC 



B. VJriting Examina£ion)|B j ues ^ 

The most coimon^^aeci&iQjXr a,f ter determining t^st 
coverage, is to consider who shouia^~vr4~fee-^iJig_examinatioa 
questions. Ninety percent (#&3%.) ,make this choi~ce7~wKil:e 
9% (#8%) elect to determine how gjf^des should be awarded- 
Four* options are presented for 'deciding who will write 
test questions. ^ 

• Ninetj^-three percent (#77%) choose to involve both 
. themselves and atheors, either members of the examination 
committee (#41%) or^ the entire course committee (#36%), 
in the question-writing. -Six., percent (#5%) elect to 
write the test alone and (1% ,^ ^1%) assign, the ^ task to 
oth^ course committee members. ''The last two groups are 
so #nall that they are not followed further. 

C. Preparation of Test^ Queistions ' 

^ The next choice involves decj-ding between how many 
questions to write for a lOO question test and how grades 
are to be awarded. Of the #77%, at this choice point, 79% 
(#61%) tackle the number of test itemfe, and 19% (#15%) 
decide to determine the grading^ system./ ' " . . 

Thfs larger group is then presented with two options:, 
to collect exactly the 100 questions required or to col- 
lect more than arte needed. . Eight percent (#5%) choose to 
cpllect only 100 questions while 92% (#56%) ^Ject to col- 
lect more than will be used on the test. , ^ 
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TABLE 47 

HOW TES't COVERAGE IS DETERMIbfED 



« « 

TOTAL POPULATION 


SECTIONS ' ' 


TOTAL 


DESCRIPTION OF OPTIONS' ^ 


C ' 


.H 








2 


^0 


38 


1 

• 


41 ^ ' 


2 Review instructors' tiJpic outlines 


• 3 


. 0 


77 


1 


' 81 , 


3 • Review instrirctional oE^iectiJiAes ' ^ 
• 


^ 4 


0 ; 




2 


84 


4 Discuss f>oSsible topics with ^ , 












course committee members 


3 


' 0 


73. 


1 2 


78 


L Resi>ondent produces own- list of topics 


' 2 • 


0 ' 


: 


1 


^2 ^ 



' TABLE 48 

INFORMATION TO BE INCLUDED IN THE INSTRUCTIONS 
TOTAL POPULATION • 



4 


^DESCRIPTION OF OPTIONS - 






SECTIOt^ X 






1 


Types of cuaswers expected 


A. 
B. 


Include 

Not Include - 


71 * 
2 


2 


Indication of whether there is a penalty 
for guessing * ' - 


Aw, 
B. 


Include 
•Not^ Include 


. • 49 
24 


3 


Indication o^f time available to^ finish 
the test' 


^A. 


Include 
-Not' Include 


. 73 

2 


4 


Indication* of test's contribution to the 
final qi^de * 


A, 


Include 
' Not' Include 


57 . 
15 


5 


Indication of how to handle questions^ 
about the tegt _ /\ 


A. 

b/ 


Iftc^lude 

Hot Incflude 


64- 

10 ' 




Comment on th^^st's impoxtancie for/' 
marginal students 


A. 
B. 


Include 
Not .Include 


9 
59 


1 


Indication of how the test will be 
graced ^ ' 

- . - / •. 


A. 
B. 


Include , . 
Not Iciclude 


25 
• / 
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When asked how to go about revising and selecting 
itjems, *79% of the facul.ty in this group (#,44%) have the 
irems reviewed by the test comrnittee and 21%' (#11%) by 
'tjhree other mejnbers of the cqurse committee.- Essentially 

jio one (#1%) did the review and selection on his/her own. 

> 

-Faculty' in the larg^ ^roup are i^w presented with 
the options of having the tfest reviewfa by the educa- 
tional specialist, writing instructions for students to 
•accompany the test, deciding how grades will be awarded, 
and submitting the t;est to the course coordinator. 
Forty-three percent (#24%) elect to have the educational 
specialist review the test, anql he recommends techi^ca;^ 
improvements to 32 of the items. Since this optioi^^ds 
with "MAKE ANOTHER CHOICfi", these fa<:ulty are now free to 
choose among the r^emaining options. 

•^Twenty-bne percent (#12%) elect^^o end the problem 
by submitting the test to the course coordinator even 
though no decision has bteen made on grading and no 
instructions have been written. An adcAtional 10% (#6%) 
elect to decide on a gfading scheme, and the remaining 
68% (#38%) move to write instructions to accompany the* 
test. This #3'B% will, be consid.ered further below. ^ 

' Though notr^JacLVinq to decide immediately on how many 
questions they Hn^^. need, faculty in the smaller group 
(#15%) ultimately have to make this decision. Sixteen 
percent (#2%) feel that exactly lOG questions jj^re needed 
^while the rest (#12%) wish to collect more than the 
required number. Of ^hese faculty, 4% (#.5%)' reviewed 
the itemi^ on their own while 86% (#12%) had the test com- 
mittee look over the items, and, 12%' (#1%) by other ^ 
members o& the course committee. ^ 

1 

D. Grading System ^ ^ ' 

Only the current .group, with #15%, is large' enough 
. in size to discuss in terms of how it decided to award 
grades. Seventy-one p,ercent (#11%) elect a fiorm- _ 
referenced approach to ' assigning grades -while only 29% 
(#4%) "choQse the more desirable criterion- referenced one. 
As implied earlier, this decision was ma'de before the 
number of items nee(?ed was chosen and before the items 
written- w&re •reviewed ^ • ' 

Thus the only decisions remaining for the* faculty in- 
this group are whether to have the test reviewed by the 
educational specialist, an option exercised by 57% (|7%); 
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to submit the tMt* tb the course- coordinator , wh^b 19% 
1[#2%) do; or to write instructions, wirich 81% (#1^%) I 
Qlect . - - ' ' • 

IT', , Instruct ioyiy tp Accompany the lest 

' In writing instructions for the test; S8% (#10%) ^^B^ 
ciff the *kind of answer sought le.g^, true/false) / 68%^^^ 
(#7%) in\aiqaj|fi whether there will be a ps^ialty for^ . ^. ^ ./ 
g\iessing, 95^P(#10%) indicate' the amount of tim^ avail^ 
able to complete the t^st, 76% (#8%) report tj^e test's 
contri^DVttion to the final grade, ^84% (#84) describe the ^ 
procedure students are to use in ^^ttirig -ansv«P^s €0 ques- 
.tions theyhave about the test, and 76% (#8%*) tell ^. 
students how<the test will be graded (e^.g«* using a" 
curve). Only 17% (#2%) would include a, statement 
detrailing ^t?he importance of thje test for* marginal 'Stu- 
dents. * 

-At this ^oint, it is again possible to have the com- 
pleted best reviewed-,* and -31%^ W^*) §xerc^.se; this option. 
Finally) th^vj^est is submitte'd 7:0 the course ' C09rdinator ^ 
by everyone. ^ ' , ' 

Returning to the |30% in^the larger grou{) vho decide 
to write instructions 97% (#37%^ tell the students how 
mucb*-time is^ available to finish-the test and 95%/(#36%)^ 
describe the *test' format - " - Smaller percent^es, 8flp. ^ 
(^#32%)', tell the students • h'ow to handle (jUest^ons^bout ^ 
•aU test itself, «3% |[#24%-) explain, yh^her *t1iere will'.be. 

penalty for .guessing, and -70% (#>2'7%) ttfell students ^ow 
luch weight the examinatijfl:! carrie^An determining the 
"inal grade. , Interestingly , 45% (/l7%) elect to tell the 
Jtutffents Kow graces would be awarded ey^S though' they -had 
made no decision on that matter'. Finally, 8% (#3%) e*eat 
to ilfdlude a /warning that the test 'is most ' critical for 
•marginal' st|ident3- This, statement has thd potential of 
'detracting from , student ' performance by unn4c5%sarily 
increasing anS^iety ^among some students, and should be 
specifically .excludec^ as it is byl92% (#35%) of the - 
i^espQndents this^ choice point. % ' ^ ^ 

•Aftet completing decisions about what- to 4-nclude in . 
^the instructions, a;Lmost half' of fehese faculty members,: 
''49% (#19%), ha^>e the test reviewed by .t'he ^ucational 
'-consultant and then join the othera in submitting it to 
•'the'cpursfe coordinator. Thus,.#3U% end the sira^ulation at 
-this*" point .v/fthout making a depision about the gradii:ig 
sysjtem. * . , .\ 



THE OPTImaJ^^UTE ^(Sfee^lgure 12) ' ^ 

^•he optimal route requires fulf illingarll three 
criteria stated at the beginning': depljteffg on a grading 
system, which a^warcjs each stude;it on th'^Dasis of his/her 
own- merit, • {producing straight-forWard questions based on 
•the mateisial taught in the ccrurse' and* devising clear 
instructions to the student that describe and explain how 

• to take the test^ Only #2.6% of the respondent group meet 
. .,all three icequirements for creating an optimal fexanjina-: 

tion* . ' ^ ' " • " , , 

A.^ Grading System/Content Coverage 

Th^ preferred^ choice for beginning the simulation -is 
* - *to determine, whether the ex'amination 'will be criterion- 
or norm-referenced because this decision qan shape the 
way the test's content is" identified aijd presentisd/ and 
the kinds cj^ questions devi^d and. selected. I,f a cri- 
, terion-ref e2?cnced system is used, items should be written 
. measuring important is ^tiejs without regard to how ^e 11 4 

• those questions sprfead out' the distribution of student's 
in the cl^ss. In contrast, a good spread, reflected in 
the^ ^iscriminatior?^ndex for each question, is particu-* 
L«:iy important if grades are to be assigned using 
norm-leferenced procedures. ,To s^chieVe .thiiS spread among 
students-, particular- kinds of .questions are .needed^ ^ 
Questions' in a norm-referenced test tend to measure. spe- 
cific fact's ^d technical terminology rather than 
iliiportant principles or concepts and may measure general 

% problem-solving or testrtaking ^ ability rather than^^ap a- 
city to manage problems that are crucial fqr the y^bje]!|>^ 
area of^Jhe course. 'A student may haye perf atoi^d:^^^adequ^^- 
ly on a norm- referenced test .but jreceive a Sw grade 
because s/he f^ll'at the Jpottom end of the distribution; 
This situation can occur even when" in^ruction hai been ' 
ve^y successful and the stud^ts ha^^^learried almoat all 
the material cqvered in the course, as stated earlier, 
<t normative information about • students is not useful in ^ 
guiding- students or in ^^^desighing instructional programs. 

Also acceptable as a sequence in test design is 
detepaining subjedt coverage' first angl then ^identifying 
J — the grading systepi. ^It is central, to the .construction of 



a good test that the question^^^^be congruent" with Ae 
material covered in the course. 
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Instr^uctional objectives embody both the content' to 
be mastetexJ and the way this mastery i§ to be-demon- 
stratedf, 'V They are, therefore, necessary for an optimal 
definition of s\A)j^ct coverage. , They, can also Ije avail- 
alJTe.to'the student as ^ gui^de /to whaV^ill be measured. 
Relying^ on 'sources of information provided by all Members 
of the qou]^se committee (instructiona^l objective?, t'c^^ic 
outlines and discussion) insures excellent subject ccwer- 

B. Writing and- Reviewing, Questions ' ; , 

''v The responsibility for writings and 'especially* 
reviewing question^ must b^ sha red to- insure 'that each 
test question is critiqued fcl||^^ine'ofce other t^an.the per- 
son who procjuced it. Thip is^pe -preferred -way* to 
identify ambiguities^ remove extraneous w.ordage , "^delete 
clues .and distractions, and 'pjodU(?e clear, .straight-,, 
forward questions. Inclii&ing. an educational spedialist. 
-as part of tlm review group is recommended, particularly^ 
for attei)Jtio|^to the technical aspects 'of questi6n; cbn- 
struc'tion*. . • • . ^ ^ ' -^^ ' . ' ^ / 




validity^ clarity. ' * >^ ' 

instructions to the Student 

This is the final step irNthe creation 'of :an elimi- 
nation that measures a student's performance fairly and 
without introducing extraneous hazards and distractions. 
A second opportunity for review by the educational spe- . 
oialist is available, h^re and should be exercisedi 

.CONCLUSION ' • ' ' ^ * * - 

" A\ stalled above., 'Oi)^ #2.6% of the 'fegpondent g2foup 
met the .critter ia of. an optimal rojate,"" although an addi- 
tional #15% managed to/develop specifications for the 
examiiiatipn; that is*, test coverage was described and a 
decisApn^as made on how tf> award grades. It appears, on 
the basis^of this sijnulation , ^ tha"^ mo'st 'faculty prbduce 
^suB-opirfmal examinations.. • * « - ' - ♦ ' 



A. ^ Thg^Primary i\reas of Concern 

!• Most faculty membefs do no€ award each student 
a. gi;^ade orf^the basis of his/her- own mer4.t/ 

* * • ' . * ^ 

2, Decisions on 'grading systef^s, when they are 
Jnvade, often follow the writing of test gue^tiorvs. ' 

B . ' Encouraging Findings ' 

,1. Most faculty mertfeers include 'instructlohs with 
^eir tests.* • . ' ^ 

'2. Most'.arrange-' t6 collect more than the required 
number of ^ items and. have them reviewed before ^they ,ar6 
selected for use 'on the teSt. 

0' 3. Pi cortsiderabl^, number of medical faculty are 
interested^in learning more about evaluation, *' ^ 
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TOTAL J^fULATIOV T^ESUlTS FOR "TEST CU^^TRUCTION" SIMULATION {Numbers lirS' estimated percent 
population selecting the option i^ndl«ted.) ' ^ ' 



IX. CONCLUSIONS AND RECOMMENDATIONS 



This Chapter focusses on three areas: 

. . \ 

A. Findings based on questions asked of all faculty 
members in the sample' reg^ding faculty members', inter- 
ests in receiving help wiQi aspects of their instructional 
responsibilities. 

B« Conclusions based on the findings in Chapters II 
through VIII regarding the areas in which faculty appear 
to be most in nepd of help. 

C. A set of recommendations for programs of faculty 
development th^t appear to be both desirable and feasible 
at this time, fased on the , findings on interests and 
needs. ^ v 

V f 

INSTRUCTIONAL AREAS WHERE FACULTY*J4EMBER»^ANT/W1LL 
ACCEPT HELP ' . 

It is clear from the survey results tjiat a consider-^ 
able proportion of faculty members at United .States ^ 
medical schools are interested in receiving help in a • 
variety of areas related to their instructional responsi- 
bilities, fhis finding is based on faculty responses to 
«?hethaj: or not they would like to receive printed matter 
•end/or attend a workshop i^^each of the thirteen areas 
lifted in Table 50. The fSrly high levels of interest 
are encouraging, especially . considering the ra^ge of dif- 
ficulties identified in the preceedSng- seven chapters. 

Whei^lthe thirteen t6pics in Table. 50 are examined 
according tor similarities in content and levels ot faculty 
• ii:itier6st in receiving printed inaterials , three fairly 
homogeneous clusters^ emerge . The fir^t xrluster^ with 
higher faculty interest^ is the area of evaluation of 
students,' 'courses, and faculty membfet*s instructional 
effectiveness. Approve imately #80% of the faculty members 
would like to ret:eive panted inf orrttation on these topics, 
#13% would not, and .#7% are^ currently undecided, c yhese* 
figures can b# related to other survfey f^.nd±ng,s vmich* 
suggest that virtually all faculty members .engage ifi eval- 
uatip.n activities at one^timlB or* another . 79 ^ . 



''^Secoi^d Preliminary Rep6rt, June^--if77, pp.* 94-97. 



TABLE 50 

.Topics In Which Faculty Members Would Like Me]p 
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Occas . Freq. 

#22 #^> 



#36 
#23 



#56 
#65 



*7 #1 



#27 #6 



#10 #25 



#18 #80 



#47 #20 

(Tutorial ) 
#17 *A4 

{Clinical) A 
#30' #26 



The data for these two coluiwis are derived from Tables 10 and 12A» E. and F» Chapter II. The S from 
11») are nJ*^ures of familiarity {have "heard' of" or "u^ed^lf rather than frequency of 

J . • ■ 
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Table 12 {Uems 1, 8 
use. 
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A second cluster encompasses thre€ common medical 
school teaching techniques: lecturing, leading small 
grouD , discussions , and providing individual supervision 
of students. Approximately two-'bhirds of, the faculty 
(#64%) want printed matter in thks& areas, #28% do not, 
and #8% are undecided, which linl^ to the finding that 
large percentages use these methods: #9,2% lecture and 
#93% lead^ small grCup* discussions, at least >occasionally<. 

The five topics dealing with individualizing 
instructio^i (topics 4 through 8 in Table 50) form a 
third cluster. Faculty interest is somewhat lower here*, 
but.it is still-* substantial : approximately #45% are 
interested in receiving printed material, #39% are not 
interested, -t^nd #16% are undecided. For the three 
topics, '{nos* 6-8, Table 50) on which we have information 
current use in medical schools is low. 

The two remaining tropics in Table 50' (NO. 1, 
formulating instructional objectives, and No. ^12, making 
best use of instructional technology) are not' related as 
content areas but do happen to have similarly hi§h 
levels of faculty- im:erest in receiving printed' 
materials (#68%, #74%). This finding reflects the high 
proportions of faculty that have had experience . in these 
areas: more than #80% have used, or at least know about, 
instructional objectives, and up to #94% of faculty have 
made some use of instructional-technology. 81 

Asking for printed materials (especially if thfey are 
free) represents an important but relatively low commit- 
menT' to improving one's teaching, and the results in the 
preceding paragraphs should be interpreted accordingly. 
A stronger commitment is expressed whfen there is a ' 
willingness to attend a workshop, which involves time . *^ 
away 'from other professional activities and possibly 
from home. When the* thirteen topics are considered from 
the point of view of interest in workshops the amount of 
ii^tarest is relatively less, although 'the rank ordering 
of topics is similar, and the level of readiness to 
attend workshops on instruction" must still be C9nsidered 
impressively^ high. * ^ 

\ ' ' f * 

• .One topic (No. irt'^ands cut from the^othersv iThirty- 
nine percent (#3S|.%) wouM^.lik« to take part in a workshop 



r 



°^Tirst Preli<>vj.nary Report, March, 1977, pp. 124-6. ' 
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on evaluating^ one ' s 'own instructional e^^ctiveness. This 
is especially encouraging since a willingness of faculty 
to be critiqued is a necessary starting point for any * ^ 
serious faculty^ development activities. 

Five topics (lecturing, (running small g^roup discus- 
sions, evaluating students, evaluating courses, and 
'making the best use. of instructional technology) hold , ' 
interest as possible workshop topics for approximately 
#31% of the population. Whilei these* topics do not form 
any single conceptual grouping, they are fundamental com- 
ponents of quality instructional programs. This level of 
faculty interest Reserves a iJesppnse. ^ 

- Finally, the five topics that relate to individual- 
izing instruction (Nos. 4-8 in Table 50) plus formulating 
instructional objectives (No. 1) and providing individual 
supervision of students (No. 13) all received the same 
response; approximately #21% are interested in attending 
^workshops on these topics. 

The 'above findings indicate a substantial interest 
in self •improvement ainong faculty members at U.S. mediqal 
schools. While interest in receiving printed matter is 
higherjfeii^ readiness to attend workshops, even the lowest 
figur^ must be consfdered impressively high. For exam- 
ple, the potential workshop topic for v/hich there is 
least interest at. this time could still involve more than 
5,000 full-time faculty members (18% of 28, 393)., and the 
potential audience for workshops could range as high as 
11,000 people (39% of the population). 

The next section of this Chapter reviews the areas 
in which the survey finding^ suggest that faculty may 
need assistance. 

IJJ^RUCTIONAL AREAS WHERE FACULTY MEMBERS NEED HELP 

r * * 

The review of the, simulations and selected question- 
naire findings suggests seven aj;eas wliere faculty members 
could profit fr6in specific assistance. The'se area's are: 

. A. determining the ^background and readiness of stu-- 
dents for instruction, 

B."^ setting expectaiiions for instruction and student 
performance, ' ^ 
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C. monitoring student progress, © ♦ ^ ' ! 

D. evaluating student performance*, ' 

- E. providing helpful. feedback and -assistance to stu- 
deilts, ' ^ - 

seeking ♦assistance from colleagues and/or consul-, 
tants, and 

G. using facility and students effectively as 
resources'. 
• 

These areas of ^ed may or may not coincide with faculty 
interest in receiving help. T;he relationship between ^ 
need and interest, and the iniplications for faculty devel- ' ^ 

opment will be discussed as the final section of this 
Chapter. ^ . ■ ^ ' . , ' ^ , • K 
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A. Background of Students* : , 

a faculty member to supervise an individual stu- 
dent Qj' conduct a group instructional* activity success- ' ^ 
fully, s/he must be aware of the^skills, knowledge, and ^ 
attitudes the students bring to ^e experience. If ^ 
faculty members are unawar^e or .\inresponsivfi to the 
students' readiness* or their level of cortipetency at course « 
entry, they may have unreasonably tiigh, low,- or inflexible 
e^cpectatiojis for them.- - ' ^ , - . . / 

V . . • • 

All the simulations erapl^asize fche importance of col- 
lecting information on the students ' ^backgrounds' in, the ' 
. solution* of educational problems. In general, 'thisrcpm-*" , * 

ponent of instruction is not mjstnaged well . In "Clinical 
Supervision," for example, pnly' #21% ask the studer^t ^-x 
, being supervised about his previous clinical. experLej^^^gs- 
and 'qrily a third of those people <#7%) pursue the conver^T , 
sation far enough to find out -if the. student has ♦ ^ 

encountfered any difficulties with unco^erative^Mttiejits*. 
Also, almSfe't #80% of the facility members send tlP^student. ♦ 
to his first compfete' patient workup without knowing anj^t 
^ 'thing about his at)ility to conduct such an activity. ^In ^ * 
^ ^'^lesearch Supervision, "• #44% ask the student about his 
V, "background, but #16% ask for this information only ^fter • ' 
the student has begun working and has encounte^red diffi-, 
culties. Thus, #72% (#56% who never ask about the / z 

student's background and #16% wHo ^sk too late) 'direct , ' \. 
the student to start his project without verifying that 
he is ready for the assigned task. _ » 



^, , The twc) simulations dealing with the 'instructiqn of 
groups prresent a slightly different picture. In "Small . 
.Group Discussion," #43% talk wi'th .the three dissatisfied 
stud&nts' in 'an *ef fort ^to \earn about their backgrounds^ 
and readiness for thife eduQatipnal -approach . ' Only #15%, 
however, talk with the other students, and only '#7% talk 
with both groups to aionsider^ these issues'^ ^ . 

Altho.ugh their actions are (Otherwise, faculty proba-^ 
bly .know that it is advantageous to learn about the 
pr^ious experience of their students. ^ In "Lecturing," 
f orxeicample , ^ully #&£* of faculty members report that 
. lectures should be adapted to the backgrounds of the ' , 
audience. In^ c(fctj:ast, though, only #28% tak^ the initia- 
tive to^ inc^uir:^ into the -students' actual backgrounds*" 
These findings from the simulations are reinforced by the 
information that only #34% of fabuJ^ty have used co^urse 
entry^ evaluation (Table 12G, Chapter II). 

In 'summary, rfew faculty members consider the back- 
grounds of* the-ir students dn planning' and managing 
^instructional experiences. 

B. Expectations for gtudents 

'4 I ' • 

formulating and conveying ^expectations to students - 
of what they J are to learn and hoyr they will be evaluated^ 
are eSsential components of effective instruction.' Stur 
^ent'^^^ed to- know these things as a guide to "their stpdy 
641 su^^ct matter and practice of skills^ x Faculty need* 
to have formulated theif expectations as a' guide to ' their 
design of a^ropriate instructional experie'nces and eval- 
uation procedures'. Thuk, 'etcpectation^ (jgoals/ objectives), 
are th^ foundation for planning. *and implementing i^fth 
instruction and e validation;, . ^ * ^ 

In "Clinical Supejrvislon, " onl^ #24% convey thefz^ 
expectation^ for thd paitient^#k:kup that the student i? 
to complete. This means thart #76% direct th§ student to 
begin the.workjap without defining the nature of the task.^ 
^ While more faculty (#53%) .do discuss the'ir 'expectations 
with the student in "Research SupervisionV' there^ .is 
still almost h^alf the faculty (#47%) .who' either do not 
or who do so only after, the student has bdgun. his work. 

:^n the* -'Lecturing" simulation, #90% indicate that 
students should be told wjiat a lecture series will* cover. 
It ds probable, however, that these faculty-are referring 
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more to i::^urse content than to how .studeni:A&re 'expected 

to use. tne informa^tion . Support for this cohtent'^ort Is • 

the finding that when faculty members t^lk with the 1-ec-. \ - 

turer, only #44% ask him what he expects students to gain 

from the lectures. \ . g 

The other f inding .>re levant to the' faculty 's formula- 
tion and use of expectations is their , minimal use of 
instructional objectives In "Course Segment Design," 
for instance, only #37% elect to design^their ^-hour seg- ^ ' 
meht using i^tructional objectives, (Chapter VII, p. 141) 
even though a considerable proportion . of. facul-ty have had ♦ 
experience with' objectives and fieel' posi^tively about 
l^eir value (Table 12A, Chapter II) . , . . 

ThUs, most faculty do not provide their 'students , 
with a /clear understanding of " what they are expected to . ^ 
learn or 'how 'they^^lL be evaluated. * It seems likely ^ . * 
that most faculty J| not explicitly artpLc\ilate their' 
goals e\^ for theKiselves. . ' ' . ^ 



rionitoring Student -Progress 



Taking mid~d^tirde riadihgs on >stud6nt3>rogre^s 'ajid 
making necessary adjustments in the inStructioml offer- 
iAgs are necessary on a regular basis to assure that 
instfeu^*m.onal goals afe being fulfilled. Faculty need to 
verify jtnat ' students are progressing as intende'd and that^ ^ 
the original Expectations for the course are still appro-^ 

priat'e. ^ \ . r 

*■ % 

In "Clinical Supervision," almost everyone (#96%)# 
*makes an attempt to observe the student in" the process of 
completing his patient vorkup." Qnly.#19^ however,* \ * 
observe the entire' process^ while #45% observe 'all but • 
ten minutes and #32%- are present for only the last twenty ^ 
minutes. . , ' 

In "Research Supervision," #91% meet with the stu- ^ 
dent to re\j^ev; his progress: Only #60%, however,* have a^ 
discussion with the student at the start of instruction 
and only #47% discuss what will represent satisfactory 
progress'. ' ' 

In '"Course Segment Design" only #13% . provide far the 
*use of daily quizzes to monitor student progress-. Thesfe 
'findings ffom the simulations, while low, are/ somewhat 
more positive than the faculty self-r^ort 'th'^ only #5% 



have used "Formative" evaluation (Table 12H, ailkpter ll). 
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In short, thfe Survey- dita indicate that many- faculty 
do .jnoni tor- student p*ro%ress^ but a fair proportion^of the 
th^ are either incomplete . in their ef f ortsf or , ui>prepare^ 
for the task./ . ' ' . \ ^' • 



tio 
e 

St 




D'. Ev^ jiation of Students ^ ' # 

The/extent to vhich students ^ave maste^exk material 
that ha;B been presented is determined evaluatincr their' 
ance/ In addition, the results of student 'fevaluar 



can ,be used to. assess. 



success, of a course and 



tiven^ess^of the instructor', ffhese important oases cif 
lit evaluatix^ make it* a clentral component of th'e 
ching- learning process . ^ ^ . " 



In ^"Research Supervision" the evaluation- of * students 
is addressed indirectly through' the setting of expecta- 
^tions^ O^ly. #53% of fjacjalty inform the stu4ent how h^ . 
will ffi^ evaluated. In'^^'Course Segment Design" faculty ^ 
are as*ke;^ to make specific decisions on whether and how 
theji^ 'will evaluate . stude'r>t4B. SeVenty-two percent C#72%) 
iriclu'de '4n. evaluation plah, but only #63% include .a" po$t-c 
te^t to verify that stfudents have .mastered ithe material, 
and even ^fewer (^3%) propose a^pretest ^'Vrhich is nece^- 
sary to, evaluate student gains. , , With . respett to ^he use 
of student evaluations of, the coutse, fewer than* half ° . 
(#49%) have the cpurse , content evaluated- ar|i pnly #35% 
ha^ve their -own performance as iiistructor evalup.ted. _ 

• In ; "Test- Cpnstruction" th^e only aspect of evaluation 
considered is -the ^preparation -pf an *ob jective^ test . Only 
#3%/manage .'this problem in the "optimal" manner. In 
"short, there ^arer a variety of evaluation issues that ^ 
faculty fail to address..** ' • * 

E. Feedback/Assistance to Stiadents 

MonitOfring student progress and' pra^idinft feedback 
and additional^ assi&tfence are related isiuesT^, Much of 
the potential^ value of, an instructional experience^- i^ ■ 
lost if an instructor >dd6s not provid§ appropriate feed- 
back. Also, ineffective is* providi^g^ studentB with 
feedback at a point' when they^.are unable to modify their 
work.^ ^ ' . « « 



In ^Clini 
.seemin 
#16% 



1 S^pervi^sion/* #86% provide direct and/ 
ingly appfo^iate feedback ^ the studeVt, but -pnlyl 
had "engaged in those prior activities on which^ ful^fy 
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helpful feedback can be based. - Neveryiaiess , iri*^* 
selecting the appropriate option ; f ac<fltyi^icate a ' . 
recognition 'of -what, constitutes helpful feedBack. *' » 

• • • * ; # ' 

* Tlx© . findings in "Resetirch Siapervjzsion" are siiy.lar. 
'While #61% are supportive in their feedback and express-, 

a willijxgness.jto provide further assistance, only #5% 
^^rearch this point in ttie rdcommended manner (e.g., -#47% 

nevfer discuss expectation? ^prior to monitoring the stu- 
t 'dent ' s progress) > 

The findings from ."Smcill ^toup Discussion" present 
,soiftewhat simij.ar^ f indiaqs ." -Most faculty 4o demonstrate 
a^willingnegs to ^ssisy students. A sj.zable ^rd^ -(#28%) , 
however, recommend that the students transfer out of their 
group, thus prtecluding any 'further, assistance. ' And a 
third of these faculty (#9%) do so without attempts 
to resolve the difficulties the students expPbss . ^ 

. -i ■■ . — ■ . , T > \ 

It appears, theref or?7.ftha*t faculty vary in their V 
interest in providing feedback and assistance to students. 
Some engage in we^llL-ifttentioned, but unsupported, efforts 
w:hj.'ch may f ail "wh^^a'culty have no objective basis .for 
providing feeSback. For example, complementary • state*^ 
; ments tp a st'i^dent can be misleading and event harmful if 
the faculty ' member, has no evidence*. on which to base'such- 
comments. ' ^* 

■ ' *. 

.F. Assistance from Consultants and Colleagues 

TeacJhing, like medicine, is so "vast an area that it ' 
is not- possible for any one person to have mastered, it all. 
It is TLikely that mbst faculty members will run into cLr- 

( ctlrastanc^s where they can profit from outside help. ' / . 

^Knowing wheji and whom to ask for he\p are im^3rtant i 
aspects of /successful teaching. 

"Small Grqjap* Discussion"' includes opportunities ^ 
, discuss the problem »at hand with other faculty -members 
teaching the same cours.e ( undertaken by #17%4 and'with^a 
friend knowledgea^ls|j(pjj:i^mall .group techniques (done by^^ 



#3%). There is , also an^o{>portunlty to expresp •an interej._ 
in arranging for a consultation with an educationcKL spef'^ ^ 
cialist. # Oifly #10% pursue fehis^ option, '^'it ^J-Ib" not 



. 82]the other #70% may)iiave selected the appropriate 
option in the fee^b^ck section, simply bec.ause the other 
options were unattractive** | 
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possible to know why^ one kind of person is considered 
j^atljer than another. ^^These findings, however, do relate, 
proportionally, to those reported in Chapter II concerning 
peojj^e from whom facUlty members seek assistance/advice on 
instructional' issued and problems: #93% say they go to ^ 
colleagues in their own departments, at least occasionally*, 
whil6 f 28% tur.n to an educational specialist. ^ * , 

^ In'malftng recommendations to ^the faculty itfember wh^ 
has requested help in the . "Lecturing" simulation, #54% 
suggest that he turn to an eSucationa'l specialist. -This 
is a r^e- almost twice as large as ♦acuity members report 
themselves asking for suchvhelp. Seventy-four percent 
\ (#74%) volunteer to ser\fd as consultants themselves. This 
flatter figure reflects the #9 3% who report turning to mem- 
tfers of their own departments for instructional haiLp. 

» ♦ ^ .4 

' "Test Construction". .again pffers .faculty members 'the 
opportunity to turn to an educational specialist through 
a requests for a technical review of the test that had 
been constructed. The offer is available twice, #16% pur- 
sue-'.it the^ firsts time^,' #33% -the second.- ^-^ - — — 

Thus, facuU^ members do turn to others for help, and 
when they do, it is more likely to be a colleague than an 
educational specialist. V7hy this is so cannot be deter- 
mined from this study. It ma,y be that faculty have had 
,b;ad experiences with educational specialists , -they 'may 
not know what educational specialists do, such specialists 
may be unavailal^e .at tfteii: school, or there may be some 
.other reason. 

' ' G. Sources of Information . 

^ ^ * 

There are circumstances where infojrmation is needed 
.rather tHan advice 6n solving problem^. ^ Under these con^ 
ditions, it is necessary to turn^ to colleagues, ^students, 
and the educational literature for Llw ■ iflT onnation 
required-^ ' j 

\^n. 'iSmall Group Discussion," for example, #91% of/ 
faculty members turn to students fpr '•information ph the 
problem t)resented in the simulatidn.^ In this case, the • 
prob'lem directly invol^ves the students. -In the, • "Liecturing" 
simvilation, #90% of faculty members 'directly witness their 
colleague's lecture to collect information* • on his pro- 
blems. Smaller • numbers, #50% and #3,4%, turn for informa- 
ti|pn to the lecturer himself and to his students. In 



^making recd^endc^tions o4i tlje lecturer cah improve, 

* #77%r*suggest talking with competent - lecturers and #79% r 

• advise talking to students. ^ • ♦ ♦ 

' . ' ' 0 

.^^ In '"/Course Segment Design," #61% turn to cdllfeagues*^* 
for information on what tO ^teach , ^and #56% to learn what 
teaching approach is preferred. . They^ls,o query students; 
#53^talk to former students, and #26i 'talk with current 
^students' for information on what to ttfeach. Forty-one 
percent ask this question, of practicing physicians/ 

* ^rt^"Test Construction," information oh what the test- 
shouT|||. cover comes -from old tests (,#'41% ) , a review of 
instructor's topic outlines (#81%) and ' instructional ob- 
jectives (#84%). 

Thus many faculty do turn ,to colleagues, students, 
afid otrher sources for information instruction and 
' instructionally r^k^t^d activities, at least when the ' 
possibility to do sirT.s suggested to them.* Even so, the • 
proportion thart .use tlrese* sources, especially students, 
.IS low enough' to suggest that information sources are not ' ' 
used to full' advantage. 

{^COMMEND ATI ON S^FOR ^ACUL^X BEV^LOPMENT ACflVITIES 

- \ ,^ The preceeding -two. s^itions^of this .Chapter describe * 

the^areas. in which faculty membe^'rs at. United States 
.iuedical schools appear to need; and are interested in 
receiving help in improving their instructiox^ This sec- 
tion uses ta^ese' two sets of, findings to offer * 
recommendations fOr future faculty development activities. 

Aire^j^here faculty membelrs will accept heip and 
' areas wheW.they need help , are presented \ih Table 51' as , 
"row and eoliimn headings, resp<pctlvely. . The* p.rose in each^ 
0 - cell^ijli that Table^brief ly outlines conteri.t that seems 

. ' appropriate as part of facul^iy development efforts 
\ . ' \ design^ to • address problems- faculty .m^^mb'ers need to' 
^ . consider, and provide ^'topics where they want help^ 'Note 
that wnile' the. pjToblems have been determined emf>irlcally , 
^ th'e study topips are judgments of what most needs t* b^ 
, I ^ . done. ^ ^ . , 



For example, facu2tt:y jnembers would like 'to recei^ 
printed ^material and attend workshopslr^lating to a riX--' 
-ber of topics in eval-uatiCn (Table -Slf? 1st row).- ^Faqulty 
members do not, as a rule, take student backgrounds into i 
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Taye.|.l Reconinendations fpr^^aculty Development Activities 




r 



Areas in 
which faculty 
rnembers J re 
Willing to 
accept help 



Eva] uation 
Topics (9, 
10. 13) 



L ~ 

Fj>nnul ati ng Ob- 
jectives (1) 



Areas where focuU> 



Student Background 



frqvTde 'for assessi/ig 
student background (eg, 
pretesting, cijllecting 
infprmatTon on emoV^^na] 
rea-diness^, and. experiences 
Students nave had j) Be 
aware that- backg'round 
deficiencies can appear 
as other^ types of pr6l?lefns 



Useful device for describing 
Student background (e g , 
required ^ntry level skills 
and" knowledge, can be stated 
as objectives which need to 
be m^t before the student 
can be^in instruction)' » 



Makin{^ the 
best use of In- 
structional 
Techno"! og> M2)' 



TeachTTT^ 
Methods (2. 
3.-13) 



Indi vidudl }jzed 
Instruction ' 
;4,5,6,7,8) 



Some approaches^ e' , CAI} 
^an be i-sed to collect oack- 
ground ihfomidtion Other 
approaches need to nave 
r^c>ian^5ns added far collect- 
ing data on student back- 
grounds 



Generally, method's nust be^ 
diyi sed for col lectmg 
baj:kqroun4 information 
(eg , pretesting » cone 
t'ons Wi th students ) , ^ 
verify tDat students hav_, 
^hdd^expenence with cerfap 
techniques and appropriate 
expectatioos* for what instruc 
tions will be like 



Expectations 



Persons being evalu- 
ated should be aware 
of tfie purposes/goals 
for the evaluation 
(E g , in goal-free 
evaluation, the logic 
behind the data ^fc'ec- 
tion activities j^Rs 
tg be spel led ou^ 



ExpectratJons for stu- 
dent performances can 
be stated as object-i ves 
to* be met . 



Students need tt; be 
aware of expectations 
for- then, ei ther at 
the tinie ttiey begin 
workong or at sone. 
appropriate point 
duf-ing instruction 




Apti tude-treat'nent mter- 
^actions may be important • 
here ThereftM^e, student 
background inly^matiorr is 
essential • These data 
should be col lected'before 
decisions are made about 
assigning students to in- 
structional modal«ties. ^ 



Momtonjfi] Progress 



Fo'rmative a/Td ^diagnostic 
testing activi ties are 
called for. Care must be 
, taken iin\tne evaluation 
to assiire that mforma'tion 
collected can be \»sed /to 
counsel students and 
faculty. 



MoD^i tool ng- can take the 
'form of noting whether 
students meet intec^m 
and end-of-course objectives 



Some approaches (e g , CAI }' have 
functions built in Otherwise 
a mechanisfTi must be cf-eated and 
tested, the technology is ttf 
be in a^wrlf-instructional mode . 
i^not in conjunction with other 
activities in which, monitoring 
can be done) 



May be based on formal 
methods (e g , quizes 
or informal ones (e g , 
discussions with students) 
but pust be bui 1 t into 
instruction nevertheless 
Needs to be done f'requently 



Some approaches have these functions 
*buiU into them Otherwise, mecha- 
nisms must be created ^end tested 



/ 
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tuwiber: need nelp 



Assistance from A Sources of 

Feedback/Assistance Evalua1;Atfn CorTSijItants/Col leagues. Information 



Though not fomally part^ 
of the evaluation, provision^ 
should be made for using^^ 
the evaluative data to / 
. •cofmunicate. regularlyJ 
with the people bemj 
evaluated in ordir to ^ - ' 
improve learning Or rtim- 
^orce acceptable progress 


,The relationships 
^among the three 
,'e^aluatlon topics 
should be spellexl 
out'. ^ Al so , informa-^' ' 
tion on what consti- 
tutes 'a^^ood* evalu- 
ation s"^ld be 
presented . 


i — T^^^^ 

Educationy consultants: 
d^rease In importance \ 
aS facul/y becomes more ex- ♦ 
periehced. Col leagues s€^ve 
as soJrces of information and 
aid 1* interpretation of evalna- 
n^e data/ , , 

- k \ , . - * 


iiiiwriufltiun 

1 CoI'hKcs 

2\ StudWts 

3. Educational 

Specialists 

4. 'literature 

5. Other (e.g.,. 

patients, 
^ practicing , 
physician?! 

■ t 

• 

t 


Can b9 based on way's 1;^ 
Vielo/students meet 
inJ^rim and €^d-o^-course 
objectives they have not rriet ^ 
in the normal course of 
events. Also, positive 
reinforcejAent can be pro- 
vided to students who need 
no oOiC'' ass stance 


/• 

Students evaluated 
Of^the basis of 
objectives they 
master Instruction 
IS evaluated on the , 
basis of how each 
objective is mastered 
b/.a' \- (he student: 


Educational consultants 
teAph faculty^o write, use, an^ 
irft^rpret resuTts from objectives 
Co*ll\agues 'provide 'information 
bearing -on the'objectives and* 
interpret evaluative information " 
on whether the objectives have 
been ,rea 1 1 zen ^ ' * 

■ H ! — ^ ^ — 




Ed^uoetional cons'-'tants 
may be helpfti^on selection or • 
design arW njpropnate use. 
Colleagues helpful in making 
r'jrri^ular decisions and 
'-erpretmg evaluative data 


Assistance fTi% include 
shTfting student to sr. - 
^pstruction^l method 
more suUa&fe to him/ 


£ .3 iuatiop-' of stu- 
dents, programs, and 
instructors should 
be 'nc^udeW * 


In large groups, feedbackVassi s- 
Jance md:f "be based on the waj<^ 
t>ie^ whole class 1s performlngA 
with special aLttention ^iven to^ 
Ijidivldual CuS^ts ay needed." 
In small Q^ps , eacfi student 
(nay rece1/e individual (jelp. 
Assistance may cover either the 
process of -Instruction or the 
contertt 1 


' Informal techniques' 
(e.g. , questioning) , 
shpuld^be b\jilt in 

^Ev^lua£ij«n of stu- 
dents^ ^p/rograms „ 
'and instructor's - 
shoul d be' included 

i 


EdttCdtiwtfdl con^u 1 tants " * 
san offer assistaoce in matching 
teach*ing method to student ^n?eds , ' 
praviding information on how to 
"use the method choseq, ar>d offen 
-eval^jative commeTits on the success 
of the actual teaching ar>d ways to' 
.unprSve./ Colleagues 'offer advice 
on cMfrlcjIa? interest antJ inte''- 
pretation af ev4Jijati ve 'data. 

• 

k ft 
1 ^ : 


— , 

or 




Assistance ina/ inldj^e' -f, 

stiifing student to 
Kistruc tioiial method 
iflore suitable' to h>m/feer 


EvalLfcation of 
stdlertts, programs, 
^and instructors 
'shpuld,be incliKled - 

J ^ J 



aca6unt in dealing with educational isgufs ''(Table 51, 1st • 
'columri).. In offering a resoluti9p to thlit problefn. it ' 

proposed that faculty development acti;«.tie5 dealing wjrih 
'evaluation include an emphasi^pji the importance of cbl- 
lectihg information on student 'backgrounds , as they relate 
to the evaluation of students, programs and instrnctors 
(Table 51, upper left-hand Qell) . * ^ * - ' ' . 

The". content recommendations -in each cell in ^ the ' 
table are not proposals for. specific faculty development 
prdcediyres or act^ivities ; jibr do they imply th*t a-11 
recommendations will apply iequally ^t all medical schools' 
in the country.; Local needs- and .iiistit.uti<fial -character- . 
istics as well ^a^ variation^ in- faculty development ' 
persorinel must 'dictate decisions on' content and imple- 
mentation procedures A^, Jhe suggesti^sv however, are felt 
to have -general- peryinence for medical education nation-" 
ally,;* and can provide a f rameWork • f or local ^d^cisions ; 

Three areas in T!able " 51 "seem to deserve special 
attention because they represent major problems and are 
addressable .through" faculty development activfttes 4 
The firat Involves the ^reas of faculty int-erest- (rows) 
called "Teaching Methods" iand "Individualized' Instruc- 
tion," and the area of ji'eed\(cQrumn) labelled. "Student 
Background." Faculty members may . encounter 'pi-cfblems in 
their teaching, which are- due to an inappltopriate match 
of student background -with tetchier Is expectation but 
which are prone to. beihg attributed to other causes.* ^ ' • 
Bor Aample, a. student's failute at a course may be 
♦attiy-buted to lack of competence^ or twjtivation when.-, - 
in fact, the .student did --not hav% adiquate help in 
understanding what was. expected.. Faculty "development 
ijjt^rvention can be effective he^e beceuse between- #35 
aja,#50 percent of .the fapulty indicate an interest in 
afiese areas, and the instructioiial tissue is one' of\ 
ipiprovinq existing instructional* skills rather tlxan 
■ developing new ones or - n^placing .old one§ . ' , 

In considering this area , • emphat^tfis -should be placed" ' 
tjothftpn Identifying salient features of student back- 
. grounds and matching thefti to the appcopriate 
instructional modality". This kind.- of "Aptitude-Treatment- 
.Interaction" approach hiSfs been well " documented in the ' 
. literature, ,83 which means fehat relatively, little advance 
■ ^ • . • • -/ . ' 

L. J. Cronbkch and R. e. Snow, Aptit udes and 
matrgctional Methods . Wiley, New. Yofk, 1977." ' • • 



'wo^k ne^-s-to'be done befoire appropr%,at'e faculty develop- 
ment -activities can be begun. F^urther', because lnteres?t 
'already exists within a sizable segment of the population, 
l^ittle work, is likely to be needed to engage the faculty 
.In whatever helpful a9^iYitie^ 'are 'of f ered . ^ 

'The seciond area ^recommended' for attention at this . * . ' ^ 

<T time includes the same ,i|reas of 'interest (Teaching 

Methods and Individualized Instruction) but involves ' * 

•two'other areas- of need:^ m9nitoring stvJdent progress \ 
and feedbaqk/assist^ce.' As described in' the preceeding 
. paragraph, large percentages of ♦the population are '\ 
interested in the^e areas. As a result, there shfe.itld be . ► 

little difficulty i«i securing faculty participationr in ^ ^ . 
workshops or other activities on this" topic. Again,' 
these* faculty, ^development issues primarily involve 
instruction, ^ot.^the development of tata^lly. riew skills. 
In- sh(^, act(fi\Mties along the' lines recomm^ended 'should * - / 
be welr-r^eived and should result in meaningful, posi- ' ' I 

" tive' changes in instructional programs. ^ . 

finally, th^re is a concordence between interests 
and needs in the 4r.ea of evaluation. .Faculty develop- 
ment activities , could point but and emphasize the inter- 
relationships among- various evaluational activities. 
Further, since evaluation .brings^ the -important ^aspects ' , 
of te^crtin-g/learning process under scrutiny, it can 

proyivi^ an excellent vehifcle for introducfing faculty ' ^ 
uieinber| t6'the rational description and analysis of 

effec^dve instruction, and the relationship of ^' such' . * ' ' . 
instruction to improvements in student learning. This * . - ^ 
area faqultji development should aJLsQ consider thev • ^ 

* criteria for hi^h^uality evaluation. systematic' 

effort in this topic area should 'heljf faculty members 
, to conduct and interpret evaluations' of students , ' ^ 

courses, and instructors. All jqf thes'e are' necessary • ' 

compdnents of the^ prpcess ot continuous improvement of'' ' • 

instruction. . / r ' - - * • , " 



FINAL 5tEMARKS ^ * ' ' 

• . ' • * . 

. TK^a study is believed to be 'dhe first "comprfeherisrve 
look 'at teachers and teaching ip United State$ medical • 
schools:- Thus, it provides the firs.t available base'line 
against, which future studies can make comparisons. Inten- 
tioix^Jly, no findings ^re available from the prese'nt 'study " 
on individual teadhers "or 'separate schools. ' 
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The present report offers a summary of highlights 
artd major .impiicationrfs based On the survey findings. 
Tnexe are man^ further analyses and potentially important 
findiijgs tnat have yet to be oursued. It is rntended 
that these will be undertaken^ and reported in- subsequent 
publication's. / . 

The true potential value o£ this study i^ irt the 
activities that are developed and' guided, as a <:onsequeTice 
of the findin'^s. It is hoped l^hat the sponsoring" a^n- 
cies of this study, the medical schools, and Sther ^ t 
agencies will see fit to aUocate resoilpces in support • 
of progr^s suggested by the- outcomes of this ihvesti- • 
gation.' - , ' • , 

Division gf Faculty development is Linking this , 
iargei> 'set of faculty development strategies, 
jor companion activities, being pojrsued at this 




1. the> jjavelopmeat^^of- a progr^ of self-assessment 
on instruct-ion for faculty members, and^ 

2, the offering of -^Worlcshops on Factilty Develop^ 
ment" for people W^th responsibilities in this area in 
'the medical schools. 

•the self-asseslSn^nt program is being, built on the ' 
written simulat*ions us^d^n the present study.' The 
workshops include a focus on helping prepare participants 
to serve as con^itafits to their medical school colleague 
in interpreting and ^^rofiting from. the , findings .from thei 
use o£ ^selfTaesessment materials. • ^ . 

Finally, it is erjphasized that the purposes of'* this 
survey required an emphasi^on- the instructional prpbl^s 
of- medical faulty. Only ^fdugh a seaWh fon problems. - 
can apfiropriately helpful programs be designed-. ."Vet, for 
those who care about the quality of Rmeptcan medicarl 
education tneretare many causes for y^ricouragement . It, is 
likely that in the J.95t)' s aij^^orie ^jOwledgeafble' about ' ' 
medical education woqld have conS'idered as too optimi^tit: 
a prediction that in th^ ]|?70's lerge numbers of medical 
teachexs >/Ould be ^trying a Variety of -i^a jor instructional 
j.nnovacions ^and would be ag open to\evaluating^ themselves 
and imp jfoving ' their instruction as this, s^udy h^s found 
t'hem ±:o be . ' ^ • * 
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